Jun 08 23:59:11.070890 ip-10-0-130-78 systemd[1]: Starting Kubernetes Kubelet... Jun 08 23:59:11.479072 ip-10-0-130-78 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:11.479072 ip-10-0-130-78 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 23:59:11.479072 ip-10-0-130-78 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:11.479072 ip-10-0-130-78 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 23:59:11.479072 ip-10-0-130-78 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:11.480200 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.480118 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 23:59:11.486749 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486734 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:11.486749 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486748 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486752 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486755 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486759 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486762 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486766 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486769 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486772 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486775 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486777 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486780 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486783 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486786 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486789 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486792 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486794 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486797 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486800 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486802 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486811 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:11.486816 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486814 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486816 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486819 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486822 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486825 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486828 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486831 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486833 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486836 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486839 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486842 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486844 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486846 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486849 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486852 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486854 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486856 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486859 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486861 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486864 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:11.487286 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486867 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486870 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486872 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486875 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486877 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486880 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486883 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486885 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486888 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486890 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486895 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486899 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486903 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486906 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486911 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486914 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486917 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486919 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486922 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:11.487798 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486925 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486927 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486930 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486932 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486935 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486938 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486940 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486943 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486945 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486949 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486953 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486957 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486961 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486963 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486967 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486970 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486972 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486977 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486979 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:11.488259 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486982 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486985 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486987 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486990 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486993 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486995 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.486998 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487001 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487004 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487007 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487010 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487012 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487015 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487018 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487021 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487023 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487026 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487029 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487031 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:11.488731 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.487034 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:11.489860 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489837 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:11.489860 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489858 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:11.489860 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489863 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489868 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489880 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489885 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489890 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489894 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489898 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489902 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489907 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489911 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489916 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489920 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489924 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489928 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489937 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489941 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489945 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489950 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489956 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489961 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:11.490039 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489965 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489969 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489974 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489978 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489982 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489986 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.489991 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490000 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490005 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490009 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490013 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490017 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490022 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490026 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490030 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490035 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490039 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490043 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:11.490811 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490047 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490059 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490064 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490069 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490073 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490078 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490082 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490087 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490091 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490096 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490100 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490105 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490110 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490115 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490128 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490133 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490138 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490143 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490148 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:11.491270 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490152 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490156 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490161 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490166 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490170 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490175 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490180 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490189 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490193 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490198 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490202 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490206 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490211 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490215 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490219 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490223 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490227 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490232 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490237 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490246 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:11.491777 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490250 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490255 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490260 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490264 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490269 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490273 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490278 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490286 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490291 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490295 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490299 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490308 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490312 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490317 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490322 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490326 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490329 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490332 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490349 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:11.492268 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.490354 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491068 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491080 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491084 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491087 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491090 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491094 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491097 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491099 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491102 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491105 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491108 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491110 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491113 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491116 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491118 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491121 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491123 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491126 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491129 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:11.492769 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491132 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491135 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491138 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491140 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491143 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491146 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491148 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491151 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491154 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491156 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491159 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491162 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491165 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491167 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491170 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491174 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491176 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491179 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491182 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:11.493280 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491184 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491187 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491189 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491192 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491195 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491197 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491199 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491203 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491205 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491208 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491210 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491213 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491215 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491219 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491223 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491227 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491230 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491234 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491237 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:11.493750 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491240 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491245 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491249 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491252 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491255 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491258 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491261 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491264 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491267 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491270 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491273 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491276 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491279 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491283 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491285 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491288 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491291 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491294 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491296 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:11.494207 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491299 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491311 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491314 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491317 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491319 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491322 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491325 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491328 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491331 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491333 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491336 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491339 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491341 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491344 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491347 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491350 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491352 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491355 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491357 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491360 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:11.494670 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491362 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491365 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.491368 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491438 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491449 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491456 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491461 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491465 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491468 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491472 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491476 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491480 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491483 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491486 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491489 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491493 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491495 2562 flags.go:64] FLAG: --cgroup-root="" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491498 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491501 2562 flags.go:64] FLAG: --client-ca-file="" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491505 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491508 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491511 2562 flags.go:64] FLAG: --cluster-domain="" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491514 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491517 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 23:59:11.495152 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491520 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491527 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491530 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491533 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491536 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491540 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491543 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491546 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491549 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491552 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491555 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491559 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491562 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491565 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491568 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491571 2562 flags.go:64] FLAG: --enable-server="true" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491574 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491579 2562 flags.go:64] FLAG: --event-burst="100" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491582 2562 flags.go:64] FLAG: --event-qps="50" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491585 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491588 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491591 2562 flags.go:64] FLAG: --eviction-hard="" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491595 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491597 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491600 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 23:59:11.495791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491620 2562 flags.go:64] FLAG: --eviction-soft="" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491623 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491626 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491629 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491632 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491635 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491638 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491641 2562 flags.go:64] FLAG: --feature-gates="" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491646 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491649 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491652 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491655 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491658 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491661 2562 flags.go:64] FLAG: --help="false" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491664 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491667 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491673 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491676 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491680 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491684 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491687 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491690 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491693 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 23:59:11.496376 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491695 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491698 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491701 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491704 2562 flags.go:64] FLAG: --kube-reserved="" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491708 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491710 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491713 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491716 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491719 2562 flags.go:64] FLAG: --lock-file="" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491722 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491725 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491728 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491738 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491741 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491744 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491747 2562 flags.go:64] FLAG: --logging-format="text" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491750 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491755 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491758 2562 flags.go:64] FLAG: --manifest-url="" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491761 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491765 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491768 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491772 2562 flags.go:64] FLAG: --max-pods="110" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491775 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491778 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 23:59:11.497010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491782 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491785 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491789 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491792 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491795 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491802 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491805 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491808 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491812 2562 flags.go:64] FLAG: --pod-cidr="" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491814 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491820 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491823 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491826 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491829 2562 flags.go:64] FLAG: --port="10250" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491832 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491835 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b3cbbe6ab19a126" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491838 2562 flags.go:64] FLAG: --qos-reserved="" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491841 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491844 2562 flags.go:64] FLAG: --register-node="true" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491847 2562 flags.go:64] FLAG: --register-with-taints="" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491854 2562 flags.go:64] FLAG: --registry-burst="10" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491858 2562 flags.go:64] FLAG: --registry-qps="5" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491861 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491864 2562 flags.go:64] FLAG: --reserved-memory="" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491870 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 23:59:11.497649 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491873 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491876 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491879 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491882 2562 flags.go:64] FLAG: --runonce="false" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491885 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491888 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491891 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491893 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491897 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491900 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491903 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491907 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491909 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491912 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491915 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491918 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491921 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491924 2562 flags.go:64] FLAG: --system-cgroups="" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491926 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491932 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491934 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491937 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491941 2562 flags.go:64] FLAG: --tls-min-version="" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491944 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491946 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 23:59:11.498262 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491949 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491952 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491955 2562 flags.go:64] FLAG: --v="2" Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491959 2562 flags.go:64] FLAG: --version="false" Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491963 2562 flags.go:64] FLAG: --vmodule="" Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491967 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.491972 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492097 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492102 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492105 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492108 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492111 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492114 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492117 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492119 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492122 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492126 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492130 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492133 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492136 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:11.498908 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492139 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492141 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492144 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492147 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492149 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492152 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492154 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492157 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492160 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492162 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492165 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492168 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492170 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492173 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492176 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492178 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492181 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492184 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492188 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492190 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:11.499804 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492193 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492196 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492198 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492201 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492204 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492206 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492208 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492211 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492214 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492217 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492219 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492222 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492225 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492227 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492230 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492232 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492235 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492238 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492240 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:11.500734 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492243 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492245 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492248 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492251 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492253 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492256 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492258 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492261 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492263 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492266 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492269 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492274 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492277 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492279 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492282 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492285 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492287 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492290 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492292 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492295 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:11.501417 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492297 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492300 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492303 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492306 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492308 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492311 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492313 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492316 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492318 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492321 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492323 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492326 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492330 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492333 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492336 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492340 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492342 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492345 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492348 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:11.501924 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492350 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492353 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492355 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492358 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492363 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492366 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492369 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.492373 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.493317 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.501149 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.501167 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.502084 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.502097 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502182 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502191 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:11.502664 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502196 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502201 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502206 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502210 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502215 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502220 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502225 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502229 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502233 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502238 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502243 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502247 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502251 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502255 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502259 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502264 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502268 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502273 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502277 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502281 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:11.503343 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502286 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502290 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502294 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502299 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502303 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502308 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502315 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502323 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502328 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502333 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502337 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502342 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502346 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502351 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502355 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502359 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502363 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502368 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502372 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502376 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:11.504034 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502380 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502384 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502389 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502393 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502397 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502401 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502406 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502410 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502414 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502418 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502422 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502426 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502431 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502435 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502439 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502443 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502450 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502455 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502460 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:11.504619 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502465 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502472 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502477 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502482 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502486 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502492 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502496 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502500 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502505 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502509 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502513 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502517 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502521 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502526 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502531 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502535 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502539 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502543 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502547 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502552 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:11.505401 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502556 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502562 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502568 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502573 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502578 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502582 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502587 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502591 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502595 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502599 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502618 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502623 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502627 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502632 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502637 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502641 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502646 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:11.506109 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502650 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.502658 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502871 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502880 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502887 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502891 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502897 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502902 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502907 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502912 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502916 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502920 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502925 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502929 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502933 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:11.506546 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502938 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502942 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502946 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502951 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502955 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502960 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502964 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502970 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502977 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502982 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502986 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502990 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.502994 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503000 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503004 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503009 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503014 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503018 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503022 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:11.507023 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503027 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503031 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503035 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503039 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503043 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503048 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503053 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503057 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503062 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503066 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503070 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503074 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503079 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503083 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503087 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503092 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503096 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503100 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503105 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503109 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:11.507529 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503113 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503118 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503122 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503126 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503130 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503135 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503140 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503145 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503149 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503154 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503159 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503163 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503167 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503171 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503175 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503180 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503185 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503189 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503194 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503198 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:11.508043 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503202 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503206 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503213 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503218 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503223 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503228 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503233 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503237 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503242 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503247 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503251 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503256 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503260 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503267 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503272 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503277 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503282 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503286 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503291 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:11.508555 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503295 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503299 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503312 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503317 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503322 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503332 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503337 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:11.503341 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.503348 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.503500 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.506595 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.508332 2562 server.go:1019] "Starting client certificate rotation" Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.508436 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 23:59:11.509160 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.508465 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 23:59:11.511193 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.511176 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 23:59:11.512342 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.512318 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 23:59:11.522457 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.522439 2562 log.go:25] "Validated CRI v1 runtime API" Jun 08 23:59:11.525304 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.525290 2562 log.go:25] "Validated CRI v1 image API" Jun 08 23:59:11.526008 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.525990 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 23:59:11.528771 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.528755 2562 fs.go:135] Filesystem UUIDs: map[76691af7-069f-4451-911f-f8dbd6e1078d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 912cd416-fbd1-47ec-ad35-ad18d61f8dc0:/dev/nvme0n1p3] Jun 08 23:59:11.528824 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.528771 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 23:59:11.533872 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.533856 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 23:59:11.534940 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.534839 2562 manager.go:216] Machine: {Timestamp:2026-06-08 23:59:11.532669527 +0000 UTC m=+0.354771081 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3075031 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cc6c0bbef0b86dcb3251d1901aea9 SystemUUID:ec2cc6c0-bbef-0b86-dcb3-251d1901aea9 BootID:337c8f90-744e-40b2-ba80-60173d58c501 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:7b:b6:f1:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:7b:b6:f1:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:9c:60:cd:bc:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 23:59:11.534940 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.534938 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 23:59:11.535049 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.535038 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 23:59:11.536252 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.536230 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 23:59:11.536374 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.536253 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 23:59:11.537112 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.537103 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 23:59:11.537145 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.537114 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 23:59:11.537145 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.537122 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 23:59:11.537974 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.537964 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 23:59:11.539083 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.539073 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 23:59:11.543249 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543238 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 08 23:59:11.543370 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543360 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 23:59:11.543402 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543391 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 08 23:59:11.543429 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543402 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 23:59:11.543429 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543416 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 23:59:11.543429 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543427 2562 kubelet.go:398] "Adding apiserver pod source" Jun 08 23:59:11.543538 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543436 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 23:59:11.543805 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543793 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 23:59:11.543853 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.543819 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 23:59:11.546258 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.546240 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 23:59:11.548501 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.548485 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 23:59:11.548579 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.548523 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 23:59:11.549879 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549866 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 23:59:11.549956 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549887 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 23:59:11.549956 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549897 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 23:59:11.549956 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549906 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 23:59:11.549956 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549918 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 23:59:11.549956 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549927 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 23:59:11.549956 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549939 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 23:59:11.549956 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549947 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 23:59:11.549956 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549959 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 23:59:11.550216 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549968 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 23:59:11.550216 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549981 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 23:59:11.550216 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.549990 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 23:59:11.550794 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.550783 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 23:59:11.550844 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.550797 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 23:59:11.552854 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.552833 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 23:59:11.552945 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.552851 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dq9rg" Jun 08 23:59:11.552945 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.552863 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 23:59:11.553058 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.553039 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 23:59:11.553871 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.553853 2562 server.go:1268] "Started kubelet" Jun 08 23:59:11.553966 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.553935 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 23:59:11.554064 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.553983 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 23:59:11.554134 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.554112 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 23:59:11.554701 ip-10-0-130-78 systemd[1]: Started Kubernetes Kubelet. Jun 08 23:59:11.556234 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.556217 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 23:59:11.556344 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.556330 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 08 23:59:11.559757 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.558655 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-78.ec2.internal.18b7408ce66d1315 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-78.ec2.internal,UID:ip-10-0-130-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-78.ec2.internal,},FirstTimestamp:2026-06-08 23:59:11.553827605 +0000 UTC m=+0.375929159,LastTimestamp:2026-06-08 23:59:11.553827605 +0000 UTC m=+0.375929159,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-78.ec2.internal,}" Jun 08 23:59:11.559951 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.559933 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dq9rg" Jun 08 23:59:11.561436 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.561420 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 23:59:11.563657 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.563642 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 23:59:11.564551 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.564386 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 23:59:11.565256 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.565237 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:11.565545 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.565528 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 23:59:11.565711 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.565696 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 23:59:11.566111 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.566092 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 23:59:11.566219 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.566183 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 08 23:59:11.566219 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.566196 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 08 23:59:11.567186 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.567164 2562 factory.go:55] Registering systemd factory Jun 08 23:59:11.567282 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.567189 2562 factory.go:223] Registration of the systemd container factory successfully Jun 08 23:59:11.567421 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.567394 2562 factory.go:153] Registering CRI-O factory Jun 08 23:59:11.567421 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.567408 2562 factory.go:223] Registration of the crio container factory successfully Jun 08 23:59:11.567563 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.567499 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 23:59:11.567563 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.567523 2562 factory.go:103] Registering Raw factory Jun 08 23:59:11.567563 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.567543 2562 manager.go:1196] Started watching for new ooms in manager Jun 08 23:59:11.568380 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.568363 2562 manager.go:349] Starting recovery of all containers Jun 08 23:59:11.575218 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.575198 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:11.577485 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.577470 2562 manager.go:354] Recovery completed Jun 08 23:59:11.577872 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.577850 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-78.ec2.internal\" not found" node="ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.581405 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.581392 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:11.583442 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.583425 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:11.583500 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.583451 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:11.583500 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.583461 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:11.583989 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.583975 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 23:59:11.584046 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.583990 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:11.584046 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.583989 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 23:59:11.584110 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.584052 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 08 23:59:11.584812 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.584797 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:11.584855 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.584825 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:11.584855 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.584838 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:11.586195 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.586181 2562 policy_none.go:49] "None policy: Start" Jun 08 23:59:11.586195 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.586197 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 23:59:11.586296 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.586207 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 23:59:11.587928 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.587913 2562 policy_none.go:47] "Start" Jun 08 23:59:11.620192 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.620177 2562 manager.go:337] "Starting Device Plugin manager" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.620213 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.620223 2562 server.go:87] "Starting device plugin registration server" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.620519 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.620530 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.620624 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.620770 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.620783 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.621472 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.621534 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.635888 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.637043 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.637074 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.637112 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.637146 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 23:59:11.646835 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.639246 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:11.721666 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.721527 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:11.722584 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.722566 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:11.722692 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.722595 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:11.722692 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.722621 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:11.722692 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.722653 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.733677 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.733658 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.733767 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.733681 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-78.ec2.internal\": node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:11.737824 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.737808 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal"] Jun 08 23:59:11.737869 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.737865 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:11.738859 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.738835 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:11.738949 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.738879 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:11.738949 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.738895 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:11.741337 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.741324 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:11.741465 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.741450 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.741523 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.741480 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:11.743238 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.743219 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:11.743323 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.743250 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:11.743323 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.743259 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:11.743323 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.743221 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:11.743444 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.743339 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:11.743444 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.743379 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:11.746476 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.746452 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.746554 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.746519 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:11.748502 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.747426 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:11.748502 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.747454 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:11.748502 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.747477 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:11.754763 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.754744 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:11.766536 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.766516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662b9615b92800496088c04ba093a847-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"662b9615b92800496088c04ba093a847\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.766619 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.766542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5f5c03087fe8c77fec5cfd334a5bebe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-78.ec2.internal\" (UID: \"d5f5c03087fe8c77fec5cfd334a5bebe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.766619 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.766562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/662b9615b92800496088c04ba093a847-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"662b9615b92800496088c04ba093a847\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.779273 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.779257 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-78.ec2.internal\" not found" node="ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.783780 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.783763 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-78.ec2.internal\" not found" node="ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.855487 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.855443 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:11.867595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.867568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/662b9615b92800496088c04ba093a847-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"662b9615b92800496088c04ba093a847\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.867684 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.867599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662b9615b92800496088c04ba093a847-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"662b9615b92800496088c04ba093a847\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.867684 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.867637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5f5c03087fe8c77fec5cfd334a5bebe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-78.ec2.internal\" (UID: \"d5f5c03087fe8c77fec5cfd334a5bebe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.867684 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.867673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5f5c03087fe8c77fec5cfd334a5bebe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-78.ec2.internal\" (UID: \"d5f5c03087fe8c77fec5cfd334a5bebe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.867684 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.867673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/662b9615b92800496088c04ba093a847-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"662b9615b92800496088c04ba093a847\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.867821 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:11.867684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662b9615b92800496088c04ba093a847-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"662b9615b92800496088c04ba093a847\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:11.956108 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:11.956076 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.056901 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.056832 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.085293 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.085257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:12.090173 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.090016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 08 23:59:12.157479 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.157447 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.257963 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.257929 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.358475 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.358414 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.459061 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.459033 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.486148 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.486121 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:12.507360 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.507326 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 23:59:12.507505 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.507465 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 23:59:12.507505 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.507469 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 23:59:12.507505 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.507467 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 23:59:12.559676 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.559648 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.568377 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.568346 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 23:54:11 +0000 UTC" deadline="2028-02-06 19:04:18.314571374 +0000 UTC" Jun 08 23:59:12.568377 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.568373 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14587h5m5.746201793s" Jun 08 23:59:12.624081 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:12.624051 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662b9615b92800496088c04ba093a847.slice/crio-00af1c59f23f4f2a82ee6cd87f33f44e2ed006040c491604eae4318e6965fa1f WatchSource:0}: Error finding container 00af1c59f23f4f2a82ee6cd87f33f44e2ed006040c491604eae4318e6965fa1f: Status 404 returned error can't find the container with id 00af1c59f23f4f2a82ee6cd87f33f44e2ed006040c491604eae4318e6965fa1f Jun 08 23:59:12.624409 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:12.624383 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f5c03087fe8c77fec5cfd334a5bebe.slice/crio-b30151b88a979b29b993664db96e096ba87f27ae61b3cf4a4121b15118030df6 WatchSource:0}: Error finding container b30151b88a979b29b993664db96e096ba87f27ae61b3cf4a4121b15118030df6: Status 404 returned error can't find the container with id b30151b88a979b29b993664db96e096ba87f27ae61b3cf4a4121b15118030df6 Jun 08 23:59:12.628677 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.628662 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 23:59:12.640096 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.640048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" event={"ID":"d5f5c03087fe8c77fec5cfd334a5bebe","Type":"ContainerStarted","Data":"b30151b88a979b29b993664db96e096ba87f27ae61b3cf4a4121b15118030df6"} Jun 08 23:59:12.640909 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:12.640887 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" event={"ID":"662b9615b92800496088c04ba093a847","Type":"ContainerStarted","Data":"00af1c59f23f4f2a82ee6cd87f33f44e2ed006040c491604eae4318e6965fa1f"} Jun 08 23:59:12.660059 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.660031 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.760530 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.760503 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.861000 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.860970 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:12.961523 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:12.961453 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:13.062225 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.062187 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 08 23:59:13.067209 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.067048 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:13.166041 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.165843 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 08 23:59:13.175126 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.175103 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 23:59:13.176670 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.176436 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 08 23:59:13.184948 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.184887 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 23:59:13.408720 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.408690 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:13.544237 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.544202 2562 apiserver.go:52] "Watching apiserver" Jun 08 23:59:13.552201 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.552177 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 23:59:13.552660 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.552628 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-zwxxx","kube-system/global-pull-secret-syncer-7m2rg","kube-system/konnectivity-agent-nvf99","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq","openshift-cluster-node-tuning-operator/tuned-b75mk","openshift-dns/node-resolver-whcbr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal","openshift-multus/multus-additional-cni-plugins-ctthd","openshift-multus/network-metrics-daemon-vbs7g","kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal","openshift-image-registry/node-ca-l8zk8","openshift-multus/multus-n542m","openshift-network-diagnostics/network-check-target-85zlm","openshift-network-operator/iptables-alerter-kc6rs"] Jun 08 23:59:13.555367 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.555348 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:13.555453 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.555417 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:13.557467 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.557447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.557565 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.557523 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:13.559539 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.559513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:13.561710 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.561691 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.561859 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.561839 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 23:59:13.561928 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.561904 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 23:59:13.562259 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.562243 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r8pfz\"" Jun 08 23:59:13.563793 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.563762 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 23:59:13.563793 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.563784 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 23:59:13.564076 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.564021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.564326 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.564189 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 23:59:13.564326 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.564277 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p8xps\"" Jun 08 23:59:13.565499 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.565477 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 23:59:13.567391 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.567003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.567391 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.567036 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 23:59:13.567391 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.567283 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 23:59:13.568103 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.567965 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qgpkg\"" Jun 08 23:59:13.569934 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.569917 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2rwlp\"" Jun 08 23:59:13.572521 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.572500 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.572647 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.572632 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 23:59:13.572875 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.572850 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 23:59:13.575018 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.574994 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 23:59:13.575118 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.575028 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 23:59:13.575184 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.575134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.575184 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.575015 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 23:59:13.575309 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.575242 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 23:59:13.576434 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.576203 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 23:59:13.576434 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.576205 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 23:59:13.576434 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.576253 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tpt9z\"" Jun 08 23:59:13.576998 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.576975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.577073 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b4bab39-9475-4352-b23b-139700706808-konnectivity-ca\") pod \"konnectivity-agent-nvf99\" (UID: \"5b4bab39-9475-4352-b23b-139700706808\") " pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:13.577073 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-run\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577073 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnn5c\" (UniqueName: \"kubernetes.io/projected/f43a7ef4-2b19-4359-880d-e0a37348fe36-kube-api-access-mnn5c\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.577180 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-registration-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.577180 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-device-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.577180 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-kubernetes\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577180 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577158 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 23:59:13.577322 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-systemd\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577322 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-var-lib-kubelet\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577322 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.577322 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-modprobe-d\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577322 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysctl-d\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577322 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysctl-conf\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p72pw\" (UniqueName: \"kubernetes.io/projected/d20d7320-93bb-4ec8-a8e3-495f19d74c81-kube-api-access-p72pw\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577285 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 23:59:13.577595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-host\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f43a7ef4-2b19-4359-880d-e0a37348fe36-hosts-file\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.577595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysconfig\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.577595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:13.577595 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.577550 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:13.577595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b4bab39-9475-4352-b23b-139700706808-agent-certs\") pod \"konnectivity-agent-nvf99\" (UID: \"5b4bab39-9475-4352-b23b-139700706808\") " pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-sys-fs\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-kubelet-config\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-dbus\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vgg9\" (UniqueName: \"kubernetes.io/projected/9cc613f6-88c8-4f6c-b31c-0daad6988213-kube-api-access-4vgg9\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d20d7320-93bb-4ec8-a8e3-495f19d74c81-tmp\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f43a7ef4-2b19-4359-880d-e0a37348fe36-tmp-dir\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-etc-selinux\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-sys\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577918 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-lib-modules\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-tuned\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577971 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 23:59:13.578091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.577978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-socket-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.578762 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.578181 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p98ng\"" Jun 08 23:59:13.578762 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.578291 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 23:59:13.578762 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.578392 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 23:59:13.579706 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.579690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.582177 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.582022 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 23:59:13.582177 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.582077 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 23:59:13.582177 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.582024 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 23:59:13.582177 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.582095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.582177 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.582155 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fskzn\"" Jun 08 23:59:13.584388 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.584255 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 23:59:13.584388 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.584256 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cjhmx\"" Jun 08 23:59:13.584388 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.584343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n542m" Jun 08 23:59:13.584574 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.584545 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 23:59:13.584643 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.584566 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 23:59:13.586535 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.586515 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 23:59:13.586672 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.586657 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nlct9\"" Jun 08 23:59:13.595636 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.595601 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2vq7j" Jun 08 23:59:13.602932 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.602912 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2vq7j" Jun 08 23:59:13.667491 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.667419 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 23:59:13.672636 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.672597 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:13.678728 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysctl-d\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.678857 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-system-cni-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.678857 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-cni-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.678857 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-socket-dir-parent\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.678857 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-kubelet\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.678857 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678837 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-etc-kubernetes\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q447\" (UniqueName: \"kubernetes.io/projected/5ff80466-dd29-496b-9546-8e3619fe741b-kube-api-access-9q447\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysctl-d\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-host\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f43a7ef4-2b19-4359-880d-e0a37348fe36-hosts-file\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.678986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-host\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-system-cni-dir\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.679101 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5wtd\" (UniqueName: \"kubernetes.io/projected/ecf48ff4-bce3-4f70-9245-4508c63002b4-kube-api-access-t5wtd\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f43a7ef4-2b19-4359-880d-e0a37348fe36-hosts-file\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-cni-bin\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-multus-certs\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-sys-fs\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-cni-bin\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6995b7a1-5e3f-4866-803d-962175277565-ovn-node-metrics-cert\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f43a7ef4-2b19-4359-880d-e0a37348fe36-tmp-dir\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679287 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98f7n\" (UniqueName: \"kubernetes.io/projected/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-kube-api-access-98f7n\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-sys-fs\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-conf-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-etc-selinux\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-sys\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ff80466-dd29-496b-9546-8e3619fe741b-cni-binary-copy\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-ovn\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-sys\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-etc-selinux\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.679478 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pnvl\" (UniqueName: \"kubernetes.io/projected/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-kube-api-access-4pnvl\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-hostroot\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-tuned\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-run\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-slash\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f43a7ef4-2b19-4359-880d-e0a37348fe36-tmp-dir\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-systemd\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-run\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-registration-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-kubernetes\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-systemd\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-var-lib-kubelet\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-cnibin\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-cni-multus\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-kubernetes\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-systemd\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-log-socket\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.680276 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-var-lib-kubelet\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679853 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-registration-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-modprobe-d\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679923 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.679949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysctl-conf\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p72pw\" (UniqueName: \"kubernetes.io/projected/d20d7320-93bb-4ec8-a8e3-495f19d74c81-kube-api-access-p72pw\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-host\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680235 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ff80466-dd29-496b-9546-8e3619fe741b-multus-daemon-config\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-var-lib-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680068 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-modprobe-d\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680281 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjkbm\" (UniqueName: \"kubernetes.io/projected/6995b7a1-5e3f-4866-803d-962175277565-kube-api-access-qjkbm\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-cnibin\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-env-overrides\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680415 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-ovnkube-script-lib\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysconfig\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681107 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-os-release\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-run-netns\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysconfig\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-cni-netd\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-sysctl-conf\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-iptables-alerter-script\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b4bab39-9475-4352-b23b-139700706808-agent-certs\") pod \"konnectivity-agent-nvf99\" (UID: \"5b4bab39-9475-4352-b23b-139700706808\") " pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-k8s-cni-cncf-io\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-netns\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-systemd-units\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-etc-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-kubelet-config\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-dbus\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-kubelet-config\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vgg9\" (UniqueName: \"kubernetes.io/projected/9cc613f6-88c8-4f6c-b31c-0daad6988213-kube-api-access-4vgg9\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-dbus\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d20d7320-93bb-4ec8-a8e3-495f19d74c81-tmp\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.681896 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-node-log\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-lib-modules\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.680986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-socket-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b4bab39-9475-4352-b23b-139700706808-konnectivity-ca\") pod \"konnectivity-agent-nvf99\" (UID: \"5b4bab39-9475-4352-b23b-139700706808\") " pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnn5c\" (UniqueName: \"kubernetes.io/projected/f43a7ef4-2b19-4359-880d-e0a37348fe36-kube-api-access-mnn5c\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681108 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d20d7320-93bb-4ec8-a8e3-495f19d74c81-lib-modules\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-host-slash\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681142 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-socket-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-device-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-serviceca\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.681203 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-os-release\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.682713 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.683514 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.681296 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret podName:9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:14.181254299 +0000 UTC m=+3.003355844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret") pod "global-pull-secret-syncer-7m2rg" (UID: "9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:13.683514 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-device-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.683514 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-kubelet\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.683514 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-ovnkube-config\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.683514 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tplgv\" (UniqueName: \"kubernetes.io/projected/3ef5d3ff-9832-4b60-a130-8a41f6585f52-kube-api-access-tplgv\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:13.683514 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.683514 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9cc613f6-88c8-4f6c-b31c-0daad6988213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.683514 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.681839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b4bab39-9475-4352-b23b-139700706808-konnectivity-ca\") pod \"konnectivity-agent-nvf99\" (UID: \"5b4bab39-9475-4352-b23b-139700706808\") " pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:13.683920 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.683530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d20d7320-93bb-4ec8-a8e3-495f19d74c81-etc-tuned\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.683920 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.683552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d20d7320-93bb-4ec8-a8e3-495f19d74c81-tmp\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.684071 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.684050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b4bab39-9475-4352-b23b-139700706808-agent-certs\") pod \"konnectivity-agent-nvf99\" (UID: \"5b4bab39-9475-4352-b23b-139700706808\") " pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:13.687026 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.687000 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:13.687026 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.687028 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:13.687165 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.687041 2562 projected.go:196] Error preparing data for projected volume kube-api-access-zwq48 for pod openshift-network-diagnostics/network-check-target-85zlm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:13.687165 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.687111 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48 podName:2caa6272-6c5d-436e-833c-3c91d309e350 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:14.187093469 +0000 UTC m=+3.009195012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zwq48" (UniqueName: "kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48") pod "network-check-target-85zlm" (UID: "2caa6272-6c5d-436e-833c-3c91d309e350") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:13.687321 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.687302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p72pw\" (UniqueName: \"kubernetes.io/projected/d20d7320-93bb-4ec8-a8e3-495f19d74c81-kube-api-access-p72pw\") pod \"tuned-b75mk\" (UID: \"d20d7320-93bb-4ec8-a8e3-495f19d74c81\") " pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.689291 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.689269 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnn5c\" (UniqueName: \"kubernetes.io/projected/f43a7ef4-2b19-4359-880d-e0a37348fe36-kube-api-access-mnn5c\") pod \"node-resolver-whcbr\" (UID: \"f43a7ef4-2b19-4359-880d-e0a37348fe36\") " pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.689394 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.689301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vgg9\" (UniqueName: \"kubernetes.io/projected/9cc613f6-88c8-4f6c-b31c-0daad6988213-kube-api-access-4vgg9\") pod \"aws-ebs-csi-driver-node-m97kq\" (UID: \"9cc613f6-88c8-4f6c-b31c-0daad6988213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.782552 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-system-cni-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782552 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-cni-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-socket-dir-parent\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-kubelet\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-etc-kubernetes\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782656 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-system-cni-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q447\" (UniqueName: \"kubernetes.io/projected/5ff80466-dd29-496b-9546-8e3619fe741b-kube-api-access-9q447\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-cni-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-kubelet\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782680 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-socket-dir-parent\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-system-cni-dir\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782732 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-etc-kubernetes\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.782768 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5wtd\" (UniqueName: \"kubernetes.io/projected/ecf48ff4-bce3-4f70-9245-4508c63002b4-kube-api-access-t5wtd\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-system-cni-dir\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-cni-bin\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-multus-certs\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-cni-bin\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6995b7a1-5e3f-4866-803d-962175277565-ovn-node-metrics-cert\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782933 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-multus-certs\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98f7n\" (UniqueName: \"kubernetes.io/projected/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-kube-api-access-98f7n\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-cni-bin\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-conf-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.782901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-cni-bin\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ff80466-dd29-496b-9546-8e3619fe741b-cni-binary-copy\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-ovn\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783086 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-multus-conf-dir\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783106 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-ovn\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.783256 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pnvl\" (UniqueName: \"kubernetes.io/projected/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-kube-api-access-4pnvl\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-hostroot\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-slash\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-systemd\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-cnibin\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-cni-multus\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-log-socket\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-log-socket\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-host\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783377 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-systemd\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ff80466-dd29-496b-9546-8e3619fe741b-multus-daemon-config\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-cnibin\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-var-lib-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783385 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-hostroot\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-slash\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjkbm\" (UniqueName: \"kubernetes.io/projected/6995b7a1-5e3f-4866-803d-962175277565-kube-api-access-qjkbm\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784070 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-var-lib-cni-multus\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783451 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-host\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-var-lib-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.783530 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-cnibin\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:13.783582 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:14.283563945 +0000 UTC m=+3.105665489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-cnibin\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-env-overrides\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783663 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-ovnkube-script-lib\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-os-release\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-run-netns\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-cni-netd\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-iptables-alerter-script\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-k8s-cni-cncf-io\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.784908 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-netns\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-systemd-units\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-etc-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-node-log\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ff80466-dd29-496b-9546-8e3619fe741b-cni-binary-copy\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.783973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ff80466-dd29-496b-9546-8e3619fe741b-multus-daemon-config\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784022 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-k8s-cni-cncf-io\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-etc-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-host-slash\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784108 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-serviceca\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-node-log\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-host-slash\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-os-release\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.785640 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-os-release\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784191 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ff80466-dd29-496b-9546-8e3619fe741b-host-run-netns\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-kubelet\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-env-overrides\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-ovnkube-config\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-ovnkube-script-lib\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-cni-netd\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784261 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-run-openvswitch\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-kubelet\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-os-release\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784324 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-host-run-netns\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tplgv\" (UniqueName: \"kubernetes.io/projected/3ef5d3ff-9832-4b60-a130-8a41f6585f52-kube-api-access-tplgv\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6995b7a1-5e3f-4866-803d-962175277565-systemd-units\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecf48ff4-bce3-4f70-9245-4508c63002b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784728 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-iptables-alerter-script\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.784817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6995b7a1-5e3f-4866-803d-962175277565-ovnkube-config\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.786469 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.785037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecf48ff4-bce3-4f70-9245-4508c63002b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.787282 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.785285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-serviceca\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.787282 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.785388 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6995b7a1-5e3f-4866-803d-962175277565-ovn-node-metrics-cert\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.792268 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.792244 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pnvl\" (UniqueName: \"kubernetes.io/projected/cb60fbd7-daa9-45dd-aa12-d83ac8b55187-kube-api-access-4pnvl\") pod \"iptables-alerter-kc6rs\" (UID: \"cb60fbd7-daa9-45dd-aa12-d83ac8b55187\") " pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.792545 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.792476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98f7n\" (UniqueName: \"kubernetes.io/projected/9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4-kube-api-access-98f7n\") pod \"node-ca-l8zk8\" (UID: \"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4\") " pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.792675 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.792623 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjkbm\" (UniqueName: \"kubernetes.io/projected/6995b7a1-5e3f-4866-803d-962175277565-kube-api-access-qjkbm\") pod \"ovnkube-node-zwxxx\" (UID: \"6995b7a1-5e3f-4866-803d-962175277565\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.793123 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.793086 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q447\" (UniqueName: \"kubernetes.io/projected/5ff80466-dd29-496b-9546-8e3619fe741b-kube-api-access-9q447\") pod \"multus-n542m\" (UID: \"5ff80466-dd29-496b-9546-8e3619fe741b\") " pod="openshift-multus/multus-n542m" Jun 08 23:59:13.793318 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.793294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5wtd\" (UniqueName: \"kubernetes.io/projected/ecf48ff4-bce3-4f70-9245-4508c63002b4-kube-api-access-t5wtd\") pod \"multus-additional-cni-plugins-ctthd\" (UID: \"ecf48ff4-bce3-4f70-9245-4508c63002b4\") " pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.793788 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.793771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tplgv\" (UniqueName: \"kubernetes.io/projected/3ef5d3ff-9832-4b60-a130-8a41f6585f52-kube-api-access-tplgv\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:13.873782 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.873742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:13.881133 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.881104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" Jun 08 23:59:13.891717 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.891696 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b75mk" Jun 08 23:59:13.896402 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.896382 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whcbr" Jun 08 23:59:13.903068 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.903050 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:13.911120 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.911098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ctthd" Jun 08 23:59:13.917715 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.917667 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kc6rs" Jun 08 23:59:13.926238 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.926214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8zk8" Jun 08 23:59:13.931840 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:13.931819 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n542m" Jun 08 23:59:14.186559 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.186480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:14.186706 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:14.186597 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:14.186706 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:14.186661 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret podName:9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:15.186646199 +0000 UTC m=+4.008747740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret") pod "global-pull-secret-syncer-7m2rg" (UID: "9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:14.287502 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.287472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:14.287698 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.287517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:14.287698 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:14.287585 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:14.287698 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:14.287653 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:14.287698 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:14.287667 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:14.287698 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:14.287674 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:15.287652221 +0000 UTC m=+4.109753777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:14.287698 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:14.287679 2562 projected.go:196] Error preparing data for projected volume kube-api-access-zwq48 for pod openshift-network-diagnostics/network-check-target-85zlm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:14.287992 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:14.287735 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48 podName:2caa6272-6c5d-436e-833c-3c91d309e350 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:15.287720233 +0000 UTC m=+4.109821778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwq48" (UniqueName: "kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48") pod "network-check-target-85zlm" (UID: "2caa6272-6c5d-436e-833c-3c91d309e350") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:14.446123 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.445940 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43a7ef4_2b19_4359_880d_e0a37348fe36.slice/crio-99e3d650b9691f172dcc7dbdce0bd20fc6dec4e92501f3f46d101401eedf255e WatchSource:0}: Error finding container 99e3d650b9691f172dcc7dbdce0bd20fc6dec4e92501f3f46d101401eedf255e: Status 404 returned error can't find the container with id 99e3d650b9691f172dcc7dbdce0bd20fc6dec4e92501f3f46d101401eedf255e Jun 08 23:59:14.446891 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.446866 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff80466_dd29_496b_9546_8e3619fe741b.slice/crio-b7b9fd33a340b0036bcf01d5745736d64c7266aa5ad78c5282baba85e1a47c47 WatchSource:0}: Error finding container b7b9fd33a340b0036bcf01d5745736d64c7266aa5ad78c5282baba85e1a47c47: Status 404 returned error can't find the container with id b7b9fd33a340b0036bcf01d5745736d64c7266aa5ad78c5282baba85e1a47c47 Jun 08 23:59:14.450766 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.450740 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6995b7a1_5e3f_4866_803d_962175277565.slice/crio-ed8eb348e0fd25860d51660c5cc04e8e2b0a30d34f89db20fa91c89d1592a18c WatchSource:0}: Error finding container ed8eb348e0fd25860d51660c5cc04e8e2b0a30d34f89db20fa91c89d1592a18c: Status 404 returned error can't find the container with id ed8eb348e0fd25860d51660c5cc04e8e2b0a30d34f89db20fa91c89d1592a18c Jun 08 23:59:14.453284 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.453263 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2f7486_9bbd_4e3f_9548_cc6aa46e58f4.slice/crio-c56e7c95ec0bdc003e0fa2dd04d68ba16c883f3598832cf89a63c8a79ae2243c WatchSource:0}: Error finding container c56e7c95ec0bdc003e0fa2dd04d68ba16c883f3598832cf89a63c8a79ae2243c: Status 404 returned error can't find the container with id c56e7c95ec0bdc003e0fa2dd04d68ba16c883f3598832cf89a63c8a79ae2243c Jun 08 23:59:14.475277 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.475256 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20d7320_93bb_4ec8_a8e3_495f19d74c81.slice/crio-006242da8376605c106e996743071587320244afaf979463b82403b3864b9dcf WatchSource:0}: Error finding container 006242da8376605c106e996743071587320244afaf979463b82403b3864b9dcf: Status 404 returned error can't find the container with id 006242da8376605c106e996743071587320244afaf979463b82403b3864b9dcf Jun 08 23:59:14.476881 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.476860 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb60fbd7_daa9_45dd_aa12_d83ac8b55187.slice/crio-8bd3ec06719f3931e34610d900ee2074f099a9d7e3b8ca3594f0d4e18b8abb50 WatchSource:0}: Error finding container 8bd3ec06719f3931e34610d900ee2074f099a9d7e3b8ca3594f0d4e18b8abb50: Status 404 returned error can't find the container with id 8bd3ec06719f3931e34610d900ee2074f099a9d7e3b8ca3594f0d4e18b8abb50 Jun 08 23:59:14.477550 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.477525 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf48ff4_bce3_4f70_9245_4508c63002b4.slice/crio-8b5bc7aff53ca4a683504b803a811bd4d6ff40bcfa22b38ac6057b6ebc550e9d WatchSource:0}: Error finding container 8b5bc7aff53ca4a683504b803a811bd4d6ff40bcfa22b38ac6057b6ebc550e9d: Status 404 returned error can't find the container with id 8b5bc7aff53ca4a683504b803a811bd4d6ff40bcfa22b38ac6057b6ebc550e9d Jun 08 23:59:14.479193 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.479169 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc613f6_88c8_4f6c_b31c_0daad6988213.slice/crio-89b93a735e28578e52dcf86c3a8b4192b368cd8697b6e03d413e3f8ffb7b6b9d WatchSource:0}: Error finding container 89b93a735e28578e52dcf86c3a8b4192b368cd8697b6e03d413e3f8ffb7b6b9d: Status 404 returned error can't find the container with id 89b93a735e28578e52dcf86c3a8b4192b368cd8697b6e03d413e3f8ffb7b6b9d Jun 08 23:59:14.479951 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:14.479931 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4bab39_9475_4352_b23b_139700706808.slice/crio-0effa85f5feded533427e845f405f2bb713f6074c8f177d173fea675d0f83f61 WatchSource:0}: Error finding container 0effa85f5feded533427e845f405f2bb713f6074c8f177d173fea675d0f83f61: Status 404 returned error can't find the container with id 0effa85f5feded533427e845f405f2bb713f6074c8f177d173fea675d0f83f61 Jun 08 23:59:14.606749 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.606671 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 23:54:13 +0000 UTC" deadline="2028-03-10 06:52:46.691384772 +0000 UTC" Jun 08 23:59:14.606749 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.606752 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15366h53m32.084643355s" Jun 08 23:59:14.647261 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.647229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nvf99" event={"ID":"5b4bab39-9475-4352-b23b-139700706808","Type":"ContainerStarted","Data":"0effa85f5feded533427e845f405f2bb713f6074c8f177d173fea675d0f83f61"} Jun 08 23:59:14.648436 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.648408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kc6rs" event={"ID":"cb60fbd7-daa9-45dd-aa12-d83ac8b55187","Type":"ContainerStarted","Data":"8bd3ec06719f3931e34610d900ee2074f099a9d7e3b8ca3594f0d4e18b8abb50"} Jun 08 23:59:14.649479 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.649453 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctthd" event={"ID":"ecf48ff4-bce3-4f70-9245-4508c63002b4","Type":"ContainerStarted","Data":"8b5bc7aff53ca4a683504b803a811bd4d6ff40bcfa22b38ac6057b6ebc550e9d"} Jun 08 23:59:14.650749 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.650728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n542m" event={"ID":"5ff80466-dd29-496b-9546-8e3619fe741b","Type":"ContainerStarted","Data":"b7b9fd33a340b0036bcf01d5745736d64c7266aa5ad78c5282baba85e1a47c47"} Jun 08 23:59:14.654260 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.654238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" event={"ID":"9cc613f6-88c8-4f6c-b31c-0daad6988213","Type":"ContainerStarted","Data":"89b93a735e28578e52dcf86c3a8b4192b368cd8697b6e03d413e3f8ffb7b6b9d"} Jun 08 23:59:14.655459 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.655436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b75mk" event={"ID":"d20d7320-93bb-4ec8-a8e3-495f19d74c81","Type":"ContainerStarted","Data":"006242da8376605c106e996743071587320244afaf979463b82403b3864b9dcf"} Jun 08 23:59:14.656317 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.656285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8zk8" event={"ID":"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4","Type":"ContainerStarted","Data":"c56e7c95ec0bdc003e0fa2dd04d68ba16c883f3598832cf89a63c8a79ae2243c"} Jun 08 23:59:14.657337 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.657319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"ed8eb348e0fd25860d51660c5cc04e8e2b0a30d34f89db20fa91c89d1592a18c"} Jun 08 23:59:14.661157 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.661139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whcbr" event={"ID":"f43a7ef4-2b19-4359-880d-e0a37348fe36","Type":"ContainerStarted","Data":"99e3d650b9691f172dcc7dbdce0bd20fc6dec4e92501f3f46d101401eedf255e"} Jun 08 23:59:14.662911 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.662889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" event={"ID":"d5f5c03087fe8c77fec5cfd334a5bebe","Type":"ContainerStarted","Data":"156a781f9a9277aa31c0eb1216f9be2cab5e83f049f718cbbdc440ed6ccf157f"} Jun 08 23:59:14.676001 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.675942 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" podStartSLOduration=1.675930799 podStartE2EDuration="1.675930799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:14.675099132 +0000 UTC m=+3.497200694" watchObservedRunningTime="2026-06-08 23:59:14.675930799 +0000 UTC m=+3.498032362" Jun 08 23:59:14.929253 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:14.928956 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:15.195972 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.195889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:15.196144 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.196047 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:15.196144 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.196116 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret podName:9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:17.196095421 +0000 UTC m=+6.018197021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret") pod "global-pull-secret-syncer-7m2rg" (UID: "9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:15.297390 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.297247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:15.297390 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.297305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:15.297654 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.297484 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:15.297654 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.297505 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:15.297654 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.297517 2562 projected.go:196] Error preparing data for projected volume kube-api-access-zwq48 for pod openshift-network-diagnostics/network-check-target-85zlm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:15.297654 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.297580 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48 podName:2caa6272-6c5d-436e-833c-3c91d309e350 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:17.297562133 +0000 UTC m=+6.119663680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwq48" (UniqueName: "kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48") pod "network-check-target-85zlm" (UID: "2caa6272-6c5d-436e-833c-3c91d309e350") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:15.297861 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.297676 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:15.297861 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.297716 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:17.29770385 +0000 UTC m=+6.119805407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:15.607916 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.607872 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 23:54:13 +0000 UTC" deadline="2028-01-03 01:29:08.30847402 +0000 UTC" Jun 08 23:59:15.607916 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.607914 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13753h29m52.700565138s" Jun 08 23:59:15.640706 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.639781 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:15.640706 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.639908 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:15.640706 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.640293 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:15.640706 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.640380 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:15.640706 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.640443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:15.640706 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:15.640521 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:15.697969 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.696945 2562 generic.go:356] "Generic (PLEG): container finished" podID="662b9615b92800496088c04ba093a847" containerID="1e72065acf766e86e6a94373771d84debf2ae344aa2c503f55c4129b547792e1" exitCode=0 Jun 08 23:59:15.697969 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:15.697662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" event={"ID":"662b9615b92800496088c04ba093a847","Type":"ContainerDied","Data":"1e72065acf766e86e6a94373771d84debf2ae344aa2c503f55c4129b547792e1"} Jun 08 23:59:16.728799 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:16.728421 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" event={"ID":"662b9615b92800496088c04ba093a847","Type":"ContainerStarted","Data":"80ba181d5656b63198bb302ee9c0dbf2949450467af3c5ec9a9f8ea4551b435b"} Jun 08 23:59:16.743361 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:16.742875 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" podStartSLOduration=3.7428568650000003 podStartE2EDuration="3.742856865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:16.74209613 +0000 UTC m=+5.564197700" watchObservedRunningTime="2026-06-08 23:59:16.742856865 +0000 UTC m=+5.564958431" Jun 08 23:59:17.213975 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:17.213368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:17.213975 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.213531 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:17.213975 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.213620 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret podName:9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:21.2135839 +0000 UTC m=+10.035685447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret") pod "global-pull-secret-syncer-7m2rg" (UID: "9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:17.314497 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:17.314338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:17.314497 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:17.314399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:17.314792 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.314511 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:17.314792 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.314589 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:21.314567701 +0000 UTC m=+10.136669268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:17.314792 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.314597 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:17.314792 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.314650 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:17.314792 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.314665 2562 projected.go:196] Error preparing data for projected volume kube-api-access-zwq48 for pod openshift-network-diagnostics/network-check-target-85zlm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:17.314792 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.314716 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48 podName:2caa6272-6c5d-436e-833c-3c91d309e350 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:21.314699664 +0000 UTC m=+10.136801204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwq48" (UniqueName: "kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48") pod "network-check-target-85zlm" (UID: "2caa6272-6c5d-436e-833c-3c91d309e350") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:17.640193 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:17.640150 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:17.640366 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.640289 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:17.640433 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:17.640372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:17.640493 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.640461 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:17.641036 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:17.640574 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:17.641036 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:17.640677 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:19.638526 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:19.638399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:19.638526 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:19.638416 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:19.639120 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:19.638560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:19.639120 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:19.638586 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:19.639120 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:19.638683 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:19.639120 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:19.638757 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:21.247750 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:21.247676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:21.248206 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.247836 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:21.248206 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.247902 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret podName:9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:29.247881596 +0000 UTC m=+18.069983137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret") pod "global-pull-secret-syncer-7m2rg" (UID: "9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:21.349288 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:21.348555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:21.349288 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:21.348640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:21.349288 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.348821 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:21.349288 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.348840 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:21.349288 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.348852 2562 projected.go:196] Error preparing data for projected volume kube-api-access-zwq48 for pod openshift-network-diagnostics/network-check-target-85zlm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:21.349288 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.348915 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48 podName:2caa6272-6c5d-436e-833c-3c91d309e350 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:29.34889633 +0000 UTC m=+18.170997888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwq48" (UniqueName: "kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48") pod "network-check-target-85zlm" (UID: "2caa6272-6c5d-436e-833c-3c91d309e350") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:21.349288 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.349029 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:21.349288 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.349091 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:29.349077771 +0000 UTC m=+18.171179319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:21.638541 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:21.638464 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:21.638708 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:21.638573 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:21.638708 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.638588 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:21.638708 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.638686 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:21.638874 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:21.638750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:21.638874 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:21.638835 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:23.637446 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:23.637411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:23.637925 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:23.637411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:23.637925 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:23.637531 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:23.637925 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:23.637535 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:23.637925 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:23.637630 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:23.637925 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:23.637730 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:25.638413 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:25.638373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:25.638413 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:25.638413 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:25.638958 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:25.638373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:25.638958 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:25.638508 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:25.638958 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:25.638575 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:25.638958 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:25.638685 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:27.637863 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:27.637825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:27.638292 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:27.637825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:27.638292 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:27.637958 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:27.638292 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:27.638068 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:27.638292 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:27.637825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:27.638292 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:27.638201 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:29.309174 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:29.309123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:29.309688 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.309299 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:29.309688 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.309386 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret podName:9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:45.309364538 +0000 UTC m=+34.131466080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret") pod "global-pull-secret-syncer-7m2rg" (UID: "9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:29.409790 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:29.409747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:29.409957 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:29.409810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:29.409957 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.409900 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:29.410065 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.409962 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:29.410065 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.409976 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:45.409959312 +0000 UTC m=+34.232060853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:29.410065 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.409983 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:29.410065 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.409997 2562 projected.go:196] Error preparing data for projected volume kube-api-access-zwq48 for pod openshift-network-diagnostics/network-check-target-85zlm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:29.410065 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.410046 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48 podName:2caa6272-6c5d-436e-833c-3c91d309e350 nodeName:}" failed. No retries permitted until 2026-06-08 23:59:45.410030636 +0000 UTC m=+34.232132192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwq48" (UniqueName: "kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48") pod "network-check-target-85zlm" (UID: "2caa6272-6c5d-436e-833c-3c91d309e350") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:29.637925 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:29.637837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:29.637925 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:29.637858 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:29.637925 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:29.637851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:29.638171 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.637968 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:29.638171 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.638110 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:29.638249 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:29.638204 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:31.638471 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:31.638436 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:31.638921 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:31.638543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:31.638921 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:31.638552 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:31.638921 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:31.638669 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:31.638921 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:31.638704 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:31.638921 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:31.638776 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:33.638257 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.638228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:33.639091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.638228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:33.639091 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:33.638344 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:33.639091 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:33.638453 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:33.639091 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.638225 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:33.639091 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:33.638549 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:33.765490 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.765277 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8zk8" event={"ID":"9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4","Type":"ContainerStarted","Data":"bad1468e49c355da6c94e73ed538e7aeab892917a79108c80a3236cde50ae355"} Jun 08 23:59:33.768068 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.768046 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 08 23:59:33.768448 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.768427 2562 generic.go:356] "Generic (PLEG): container finished" podID="6995b7a1-5e3f-4866-803d-962175277565" containerID="62ee2156adaa4b2a8418cc59a7debb06d2bdf5a235e6dfd145e31c63fe863170" exitCode=1 Jun 08 23:59:33.768557 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.768459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"5570a26b836d41171c2e2d5f5f84967810797d3c1666b4834555531d85914411"} Jun 08 23:59:33.768557 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.768541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"4b5deddf885a9c39a2c12186ed3d4a4022e779ff909a5988ea95322b8b91b59f"} Jun 08 23:59:33.768841 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.768592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerDied","Data":"62ee2156adaa4b2a8418cc59a7debb06d2bdf5a235e6dfd145e31c63fe863170"} Jun 08 23:59:33.768841 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.768672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"fad55cc1f4d99900610bacd16dbe166b7bb30c7a62a1629039a3c5f7c5d968d3"} Jun 08 23:59:33.770339 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.770320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whcbr" event={"ID":"f43a7ef4-2b19-4359-880d-e0a37348fe36","Type":"ContainerStarted","Data":"3e48bca22ba24df461335c9b9dd097df39b54a7920bd712a873e988632811b86"} Jun 08 23:59:33.772545 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.772525 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nvf99" event={"ID":"5b4bab39-9475-4352-b23b-139700706808","Type":"ContainerStarted","Data":"1acbb2ed91d0115eee5984dd75981d87b3ba21b7ec2f92c15c11cb395804d896"} Jun 08 23:59:33.774416 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.774347 2562 generic.go:356] "Generic (PLEG): container finished" podID="ecf48ff4-bce3-4f70-9245-4508c63002b4" containerID="3f1111499fe64289e2175aca9201ca278a3a88bdb95b228b7de55fc63cf8f038" exitCode=0 Jun 08 23:59:33.774508 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.774429 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctthd" event={"ID":"ecf48ff4-bce3-4f70-9245-4508c63002b4","Type":"ContainerDied","Data":"3f1111499fe64289e2175aca9201ca278a3a88bdb95b228b7de55fc63cf8f038"} Jun 08 23:59:33.775929 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.775907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n542m" event={"ID":"5ff80466-dd29-496b-9546-8e3619fe741b","Type":"ContainerStarted","Data":"c76f5d6ae75580541a90442f2481ee70dfb33027b3384ff66aec09948fa362fd"} Jun 08 23:59:33.777587 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.777568 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" event={"ID":"9cc613f6-88c8-4f6c-b31c-0daad6988213","Type":"ContainerStarted","Data":"3503738aa4aab5cc3d3826f74bb41a5ba36b9782041900251d9059eaf508f8f7"} Jun 08 23:59:33.779287 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.779250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b75mk" event={"ID":"d20d7320-93bb-4ec8-a8e3-495f19d74c81","Type":"ContainerStarted","Data":"e59ead86092c8a43f06e9ac41ecaf22d57c12a0535ad2f38bb2467c8590bda8a"} Jun 08 23:59:33.781564 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.781527 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l8zk8" podStartSLOduration=4.1589306950000005 podStartE2EDuration="22.781516574s" totalImagesPullingTime="18.622585879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:33.780755551 +0000 UTC m=+22.602857115" watchObservedRunningTime="2026-06-08 23:59:33.781516574 +0000 UTC m=+22.603618185" Jun 08 23:59:33.786428 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.786357 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:33.787136 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.787118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:33.796083 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.796038 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n542m" podStartSLOduration=4.128866043 podStartE2EDuration="22.7960266s" totalImagesPullingTime="18.667160557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:33.795786849 +0000 UTC m=+22.617888417" watchObservedRunningTime="2026-06-08 23:59:33.7960266 +0000 UTC m=+22.618128163" Jun 08 23:59:33.809270 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.809225 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nvf99" podStartSLOduration=12.656233426 podStartE2EDuration="22.809208604s" totalImagesPullingTime="10.152975178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:33.80864616 +0000 UTC m=+22.630747720" watchObservedRunningTime="2026-06-08 23:59:33.809208604 +0000 UTC m=+22.631310167" Jun 08 23:59:33.842972 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.842498 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-whcbr" podStartSLOduration=4.194340482 podStartE2EDuration="22.842485471s" totalImagesPullingTime="18.648144989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:33.821405686 +0000 UTC m=+22.643507249" watchObservedRunningTime="2026-06-08 23:59:33.842485471 +0000 UTC m=+22.664587033" Jun 08 23:59:33.861142 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:33.861087 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b75mk" podStartSLOduration=4.239737543 podStartE2EDuration="22.861064723s" totalImagesPullingTime="18.62132718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:33.859849664 +0000 UTC m=+22.681951230" watchObservedRunningTime="2026-06-08 23:59:33.861064723 +0000 UTC m=+22.683166286" Jun 08 23:59:34.305258 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.305231 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 23:59:34.634775 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.634484 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T23:59:34.30525105Z","UUID":"9013868f-c6c0-4037-94c6-b4176471aea0","Handler":null,"Name":"","Endpoint":""} Jun 08 23:59:34.636289 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.636265 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 23:59:34.636412 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.636308 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 23:59:34.786157 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.786127 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 08 23:59:34.786681 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.786646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"41c36d3326520b0fb459784d910dbe0d6674643bc6f99c7dd8471eab1d6384f9"} Jun 08 23:59:34.786799 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.786768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"18ae328dd3dbb90b92a75719f06ce8dacefc4645d9a3209ad702bea49523f78a"} Jun 08 23:59:34.788489 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.788455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kc6rs" event={"ID":"cb60fbd7-daa9-45dd-aa12-d83ac8b55187","Type":"ContainerStarted","Data":"7a23ecd8f65aba0a6a64baf3f9d2e1b1c3cd2a72edc3e4193f9ccdf04a27e14a"} Jun 08 23:59:34.790755 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.790729 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" event={"ID":"9cc613f6-88c8-4f6c-b31c-0daad6988213","Type":"ContainerStarted","Data":"336de14bc333fdaa608de961b163f42eb590c039575fca9ec067baa72e89624b"} Jun 08 23:59:34.807678 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:34.807630 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kc6rs" podStartSLOduration=5.190492965 podStartE2EDuration="23.807596345s" totalImagesPullingTime="18.61710338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:34.807320688 +0000 UTC m=+23.629422251" watchObservedRunningTime="2026-06-08 23:59:34.807596345 +0000 UTC m=+23.629697911" Jun 08 23:59:35.637762 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:35.637684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:35.637918 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:35.637683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:35.637918 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:35.637684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:35.637918 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:35.637884 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:35.638087 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:35.638026 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:35.638142 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:35.638120 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:35.796083 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:35.796012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" event={"ID":"9cc613f6-88c8-4f6c-b31c-0daad6988213","Type":"ContainerStarted","Data":"5b5ec9459aff37398df62745949d419b380b85760f4acebd9776a7672594713a"} Jun 08 23:59:35.796083 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:35.796063 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 23:59:35.813779 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:35.813726 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m97kq" podStartSLOduration=4.367881472 podStartE2EDuration="24.81370699s" totalImagesPullingTime="20.445825518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:35.812908715 +0000 UTC m=+24.635010278" watchObservedRunningTime="2026-06-08 23:59:35.81370699 +0000 UTC m=+24.635808553" Jun 08 23:59:36.801434 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:36.801407 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 08 23:59:36.801997 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:36.801853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"bb7d7b2b1e3565cd3a1ca8239afc1f4d113af8debd8915a33191102433eb06f4"} Jun 08 23:59:37.637712 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:37.637680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:37.637899 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:37.637807 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:37.637899 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:37.637822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:37.638010 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:37.637680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:37.638010 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:37.637935 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:37.638101 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:37.638041 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:38.809620 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:38.809427 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 08 23:59:38.810282 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:38.810037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"0feebf0bb3d43c8858f9bf71bf0d7547da33983677f4ab14e0a88377482fab71"} Jun 08 23:59:38.810345 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:38.810285 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:38.810578 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:38.810560 2562 scope.go:117] "RemoveContainer" containerID="62ee2156adaa4b2a8418cc59a7debb06d2bdf5a235e6dfd145e31c63fe863170" Jun 08 23:59:38.811954 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:38.811927 2562 generic.go:356] "Generic (PLEG): container finished" podID="ecf48ff4-bce3-4f70-9245-4508c63002b4" containerID="95c5d9b0bb7017c0277ea56028c2b3caf068ad66868495ce9bc9f11355c323ea" exitCode=0 Jun 08 23:59:38.812067 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:38.811972 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctthd" event={"ID":"ecf48ff4-bce3-4f70-9245-4508c63002b4","Type":"ContainerDied","Data":"95c5d9b0bb7017c0277ea56028c2b3caf068ad66868495ce9bc9f11355c323ea"} Jun 08 23:59:38.827968 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:38.827949 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:39.637511 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.637478 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:39.637725 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.637489 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:39.637725 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.637618 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:39.637725 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:39.637594 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:39.637838 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:39.637732 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:39.637838 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:39.637802 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:39.817964 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.817937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 08 23:59:39.818395 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.818366 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" event={"ID":"6995b7a1-5e3f-4866-803d-962175277565","Type":"ContainerStarted","Data":"daab5752a69eeeeb15982cf6d4a3c26331000f053abd187a142d58891c810711"} Jun 08 23:59:39.818562 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.818542 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:39.818655 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.818637 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:39.834002 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.833975 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 08 23:59:39.844441 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:39.844393 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" podStartSLOduration=10.147070459 podStartE2EDuration="28.844378106s" totalImagesPullingTime="18.697307647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:39.843059067 +0000 UTC m=+28.665160630" watchObservedRunningTime="2026-06-08 23:59:39.844378106 +0000 UTC m=+28.666479669" Jun 08 23:59:40.122519 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:40.122487 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vbs7g"] Jun 08 23:59:40.122701 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:40.122636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:40.122761 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:40.122746 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:40.125909 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:40.125884 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-85zlm"] Jun 08 23:59:40.126028 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:40.125978 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:40.126088 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:40.126068 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:40.126471 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:40.126439 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7m2rg"] Jun 08 23:59:40.126559 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:40.126524 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:40.126630 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:40.126597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:40.822356 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:40.822318 2562 generic.go:356] "Generic (PLEG): container finished" podID="ecf48ff4-bce3-4f70-9245-4508c63002b4" containerID="f4585653981e56ad25f5e6fcc7f26092cfe7268ea7d49df8eeb927765fb670a7" exitCode=0 Jun 08 23:59:40.822809 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:40.822406 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctthd" event={"ID":"ecf48ff4-bce3-4f70-9245-4508c63002b4","Type":"ContainerDied","Data":"f4585653981e56ad25f5e6fcc7f26092cfe7268ea7d49df8eeb927765fb670a7"} Jun 08 23:59:41.638924 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:41.638892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:41.639094 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:41.638995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:41.639094 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:41.639037 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:41.639094 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:41.639029 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:41.639184 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:41.639122 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:41.639349 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:41.639318 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:42.590581 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:42.590542 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:42.591406 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:42.590747 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 23:59:42.591406 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:42.591324 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nvf99" Jun 08 23:59:42.830063 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:42.830031 2562 generic.go:356] "Generic (PLEG): container finished" podID="ecf48ff4-bce3-4f70-9245-4508c63002b4" containerID="0113231478d6f9463179b95b7a46f30d689090ef820059ef6fc23fdf008e386e" exitCode=0 Jun 08 23:59:42.830197 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:42.830112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctthd" event={"ID":"ecf48ff4-bce3-4f70-9245-4508c63002b4","Type":"ContainerDied","Data":"0113231478d6f9463179b95b7a46f30d689090ef820059ef6fc23fdf008e386e"} Jun 08 23:59:43.637818 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:43.637635 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:43.637818 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:43.637678 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:43.637818 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:43.637682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:43.637818 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:43.637753 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:43.638478 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:43.637873 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:43.638478 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:43.637966 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:45.327557 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:45.327322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:45.328306 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.327478 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:45.328306 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.327701 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret podName:9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:17.327683244 +0000 UTC m=+66.149784785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret") pod "global-pull-secret-syncer-7m2rg" (UID: "9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:45.428872 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:45.428832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:45.429042 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:45.428885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:45.429042 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.428992 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:45.429149 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.429070 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:17.4290513 +0000 UTC m=+66.251152846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:45.429149 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.429003 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:45.429149 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.429108 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:45.429149 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.429121 2562 projected.go:196] Error preparing data for projected volume kube-api-access-zwq48 for pod openshift-network-diagnostics/network-check-target-85zlm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:45.429149 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.429152 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48 podName:2caa6272-6c5d-436e-833c-3c91d309e350 nodeName:}" failed. No retries permitted until 2026-06-09 00:00:17.429144388 +0000 UTC m=+66.251245930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwq48" (UniqueName: "kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48") pod "network-check-target-85zlm" (UID: "2caa6272-6c5d-436e-833c-3c91d309e350") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:45.637745 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:45.637662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:45.637745 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:45.637677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:45.637961 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:45.637663 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:45.637961 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.637789 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85zlm" podUID="2caa6272-6c5d-436e-833c-3c91d309e350" Jun 08 23:59:45.637961 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.637851 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 08 23:59:45.637961 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:45.637929 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7m2rg" podUID="9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761" Jun 08 23:59:46.011408 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.011372 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeReady" Jun 08 23:59:46.011574 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.011539 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 23:59:46.053335 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.053298 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ddnnc"] Jun 08 23:59:46.057537 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.057509 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c6dk5"] Jun 08 23:59:46.057717 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.057678 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.060598 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.060571 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw7xv\"" Jun 08 23:59:46.060749 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.060694 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 23:59:46.060808 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.060783 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 23:59:46.061088 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.061063 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6dk5" Jun 08 23:59:46.063369 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.063340 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 23:59:46.063520 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.063381 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 23:59:46.063520 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.063468 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 23:59:46.063673 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.063549 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x8dqb\"" Jun 08 23:59:46.064890 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.064869 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6dk5"] Jun 08 23:59:46.067462 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.067441 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ddnnc"] Jun 08 23:59:46.134595 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.134550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfkgt\" (UniqueName: \"kubernetes.io/projected/01aec00e-ba0c-4439-af7d-cfd67a3cf234-kube-api-access-nfkgt\") pod \"ingress-canary-c6dk5\" (UID: \"01aec00e-ba0c-4439-af7d-cfd67a3cf234\") " pod="openshift-ingress-canary/ingress-canary-c6dk5" Jun 08 23:59:46.134781 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.134618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b40303a4-7e13-473f-9044-3c77f276f2fd-config-volume\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.134781 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.134655 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b40303a4-7e13-473f-9044-3c77f276f2fd-tmp-dir\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.134781 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.134720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj47j\" (UniqueName: \"kubernetes.io/projected/b40303a4-7e13-473f-9044-3c77f276f2fd-kube-api-access-rj47j\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.134781 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.134771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.134953 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.134819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01aec00e-ba0c-4439-af7d-cfd67a3cf234-cert\") pod \"ingress-canary-c6dk5\" (UID: \"01aec00e-ba0c-4439-af7d-cfd67a3cf234\") " pod="openshift-ingress-canary/ingress-canary-c6dk5" Jun 08 23:59:46.235915 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.235874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.236100 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.235959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01aec00e-ba0c-4439-af7d-cfd67a3cf234-cert\") pod \"ingress-canary-c6dk5\" (UID: \"01aec00e-ba0c-4439-af7d-cfd67a3cf234\") " pod="openshift-ingress-canary/ingress-canary-c6dk5" Jun 08 23:59:46.236100 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.236033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfkgt\" (UniqueName: \"kubernetes.io/projected/01aec00e-ba0c-4439-af7d-cfd67a3cf234-kube-api-access-nfkgt\") pod \"ingress-canary-c6dk5\" (UID: \"01aec00e-ba0c-4439-af7d-cfd67a3cf234\") " pod="openshift-ingress-canary/ingress-canary-c6dk5" Jun 08 23:59:46.236100 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:46.236036 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:46.236100 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.236058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b40303a4-7e13-473f-9044-3c77f276f2fd-config-volume\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.236100 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.236076 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b40303a4-7e13-473f-9044-3c77f276f2fd-tmp-dir\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.236100 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.236092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj47j\" (UniqueName: \"kubernetes.io/projected/b40303a4-7e13-473f-9044-3c77f276f2fd-kube-api-access-rj47j\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.236311 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:46.236126 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-08 23:59:46.736099727 +0000 UTC m=+35.558201295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 08 23:59:46.236431 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.236410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b40303a4-7e13-473f-9044-3c77f276f2fd-tmp-dir\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.236757 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.236731 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b40303a4-7e13-473f-9044-3c77f276f2fd-config-volume\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.241244 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.241216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01aec00e-ba0c-4439-af7d-cfd67a3cf234-cert\") pod \"ingress-canary-c6dk5\" (UID: \"01aec00e-ba0c-4439-af7d-cfd67a3cf234\") " pod="openshift-ingress-canary/ingress-canary-c6dk5" Jun 08 23:59:46.247847 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.247810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj47j\" (UniqueName: \"kubernetes.io/projected/b40303a4-7e13-473f-9044-3c77f276f2fd-kube-api-access-rj47j\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.247847 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.247846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfkgt\" (UniqueName: \"kubernetes.io/projected/01aec00e-ba0c-4439-af7d-cfd67a3cf234-kube-api-access-nfkgt\") pod \"ingress-canary-c6dk5\" (UID: \"01aec00e-ba0c-4439-af7d-cfd67a3cf234\") " pod="openshift-ingress-canary/ingress-canary-c6dk5" Jun 08 23:59:46.379791 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.379695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6dk5" Jun 08 23:59:46.740447 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.740412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:46.740626 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:46.740560 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:46.740738 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:46.740644 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-08 23:59:47.740625477 +0000 UTC m=+36.562727027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 08 23:59:46.936516 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:46.936481 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6dk5"] Jun 08 23:59:46.983214 ip-10-0-130-78 kubenswrapper[2562]: W0608 23:59:46.983182 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01aec00e_ba0c_4439_af7d_cfd67a3cf234.slice/crio-0984b82979706289358f6478d2224ee9e1b2b007441be01e525d5098c36de265 WatchSource:0}: Error finding container 0984b82979706289358f6478d2224ee9e1b2b007441be01e525d5098c36de265: Status 404 returned error can't find the container with id 0984b82979706289358f6478d2224ee9e1b2b007441be01e525d5098c36de265 Jun 08 23:59:47.637826 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.637622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 08 23:59:47.638366 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.637622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 08 23:59:47.638366 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.637662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 08 23:59:47.642331 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.642309 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 23:59:47.642590 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.642574 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 23:59:47.642842 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.642678 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hgn2x\"" Jun 08 23:59:47.642842 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.642694 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7v6c\"" Jun 08 23:59:47.642842 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.642745 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 23:59:47.642842 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.642796 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 23:59:47.748121 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.748087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:47.748324 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:47.748220 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:47.748324 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:47.748289 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-08 23:59:49.748269687 +0000 UTC m=+38.570371234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 08 23:59:47.845164 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.845127 2562 generic.go:356] "Generic (PLEG): container finished" podID="ecf48ff4-bce3-4f70-9245-4508c63002b4" containerID="bbd15a0265b0e12dd6e422537629a5cf8dd68e0c41966db67608e2164e07ad93" exitCode=0 Jun 08 23:59:47.845369 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.845223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctthd" event={"ID":"ecf48ff4-bce3-4f70-9245-4508c63002b4","Type":"ContainerDied","Data":"bbd15a0265b0e12dd6e422537629a5cf8dd68e0c41966db67608e2164e07ad93"} Jun 08 23:59:47.846724 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:47.846702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6dk5" event={"ID":"01aec00e-ba0c-4439-af7d-cfd67a3cf234","Type":"ContainerStarted","Data":"0984b82979706289358f6478d2224ee9e1b2b007441be01e525d5098c36de265"} Jun 08 23:59:48.853299 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:48.853267 2562 generic.go:356] "Generic (PLEG): container finished" podID="ecf48ff4-bce3-4f70-9245-4508c63002b4" containerID="5b0f8e585a0e4058a4e554f2764f90837f178a5a51a7fecfbc581b4faa293cd1" exitCode=0 Jun 08 23:59:48.853761 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:48.853314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctthd" event={"ID":"ecf48ff4-bce3-4f70-9245-4508c63002b4","Type":"ContainerDied","Data":"5b0f8e585a0e4058a4e554f2764f90837f178a5a51a7fecfbc581b4faa293cd1"} Jun 08 23:59:49.763901 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:49.763866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:49.764082 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:49.764036 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:49.764122 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:49.764101 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-08 23:59:53.764082698 +0000 UTC m=+42.586184246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 08 23:59:49.858970 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:49.858932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctthd" event={"ID":"ecf48ff4-bce3-4f70-9245-4508c63002b4","Type":"ContainerStarted","Data":"b7ca58e89e8fb87ed095b5e4aea9e9741ebfbd9596a28b5052f520da201b03a1"} Jun 08 23:59:49.860425 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:49.860399 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6dk5" event={"ID":"01aec00e-ba0c-4439-af7d-cfd67a3cf234","Type":"ContainerStarted","Data":"45c7be1cc8ba97a671adf1aee389d5e1d93bbef77c96777ef10c93c44995aa98"} Jun 08 23:59:49.882702 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:49.882648 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ctthd" podStartSLOduration=9.649166165 podStartE2EDuration="38.882632496s" totalImagesPullingTime="29.233466331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:49.88205791 +0000 UTC m=+38.704159472" watchObservedRunningTime="2026-06-08 23:59:49.882632496 +0000 UTC m=+38.704734049" Jun 08 23:59:49.898016 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:49.897964 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c6dk5" podStartSLOduration=1.897611812 podStartE2EDuration="3.897948046s" totalImagesPullingTime="2.000336234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:49.897020642 +0000 UTC m=+38.719122205" watchObservedRunningTime="2026-06-08 23:59:49.897948046 +0000 UTC m=+38.720049586" Jun 08 23:59:53.792127 ip-10-0-130-78 kubenswrapper[2562]: I0608 23:59:53.792071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 08 23:59:53.792862 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:53.792251 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:53.792862 ip-10-0-130-78 kubenswrapper[2562]: E0608 23:59:53.792337 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-09 00:00:01.792315314 +0000 UTC m=+50.614416855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 09 00:00:00.138287 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.138251 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29682720-p5shc"] Jun 09 00:00:00.176424 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.176386 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29682720-p5shc"] Jun 09 00:00:00.176584 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.176482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:00:00.179152 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.179124 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Jun 09 00:00:00.179308 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.179228 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-f8vw2\"" Jun 09 00:00:00.339805 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.339772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89k99\" (UniqueName: \"kubernetes.io/projected/552b6253-8d86-4fcf-a2d6-3e77dcea0700-kube-api-access-89k99\") pod \"image-pruner-29682720-p5shc\" (UID: \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\") " pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:00:00.339805 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.339810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/552b6253-8d86-4fcf-a2d6-3e77dcea0700-serviceca\") pod \"image-pruner-29682720-p5shc\" (UID: \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\") " pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:00:00.440499 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.440409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89k99\" (UniqueName: \"kubernetes.io/projected/552b6253-8d86-4fcf-a2d6-3e77dcea0700-kube-api-access-89k99\") pod \"image-pruner-29682720-p5shc\" (UID: \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\") " pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:00:00.440499 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.440456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/552b6253-8d86-4fcf-a2d6-3e77dcea0700-serviceca\") pod \"image-pruner-29682720-p5shc\" (UID: \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\") " pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:00:00.441155 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.441135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/552b6253-8d86-4fcf-a2d6-3e77dcea0700-serviceca\") pod \"image-pruner-29682720-p5shc\" (UID: \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\") " pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:00:00.449386 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.449352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89k99\" (UniqueName: \"kubernetes.io/projected/552b6253-8d86-4fcf-a2d6-3e77dcea0700-kube-api-access-89k99\") pod \"image-pruner-29682720-p5shc\" (UID: \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\") " pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:00:00.504448 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.504407 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:00:00.666406 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.666372 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29682720-p5shc"] Jun 09 00:00:00.670104 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:00:00.670076 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552b6253_8d86_4fcf_a2d6_3e77dcea0700.slice/crio-4431fff83ea89db305484fe76c3585c9fb68d858ab01554c3f2eb6a0edceae47 WatchSource:0}: Error finding container 4431fff83ea89db305484fe76c3585c9fb68d858ab01554c3f2eb6a0edceae47: Status 404 returned error can't find the container with id 4431fff83ea89db305484fe76c3585c9fb68d858ab01554c3f2eb6a0edceae47 Jun 09 00:00:00.888048 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.888015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29682720-p5shc" event={"ID":"552b6253-8d86-4fcf-a2d6-3e77dcea0700","Type":"ContainerStarted","Data":"aadc2a1ec8330b00247805e64b2a7e97cd524c0f570930ff382fa47ce13bdf68"} Jun 09 00:00:00.888227 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.888066 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29682720-p5shc" event={"ID":"552b6253-8d86-4fcf-a2d6-3e77dcea0700","Type":"ContainerStarted","Data":"4431fff83ea89db305484fe76c3585c9fb68d858ab01554c3f2eb6a0edceae47"} Jun 09 00:00:00.902734 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:00.902678 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29682720-p5shc" podStartSLOduration=0.902660861 podStartE2EDuration="902.660861ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:00.902426856 +0000 UTC m=+49.724528419" watchObservedRunningTime="2026-06-09 00:00:00.902660861 +0000 UTC m=+49.724762423" Jun 09 00:00:01.850217 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:01.850177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 09 00:00:01.850718 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:00:01.850328 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:01.850718 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:00:01.850389 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-09 00:00:17.850372065 +0000 UTC m=+66.672473609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 09 00:00:11.835078 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:11.835047 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwxxx" Jun 09 00:00:17.361026 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.360973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 09 00:00:17.363687 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.363665 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 00:00:17.373699 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.373677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761-original-pull-secret\") pod \"global-pull-secret-syncer-7m2rg\" (UID: \"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761\") " pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 09 00:00:17.462025 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.461987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 09 00:00:17.462186 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.462056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 09 00:00:17.464487 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.464464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 00:00:17.464576 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.464474 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 00:00:17.472556 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:00:17.472531 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:00:17.472688 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:00:17.472637 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-09 00:01:21.472595256 +0000 UTC m=+130.294696800 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : secret "metrics-daemon-secret" not found Jun 09 00:00:17.474655 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.474639 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 00:00:17.485848 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.485830 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwq48\" (UniqueName: \"kubernetes.io/projected/2caa6272-6c5d-436e-833c-3c91d309e350-kube-api-access-zwq48\") pod \"network-check-target-85zlm\" (UID: \"2caa6272-6c5d-436e-833c-3c91d309e350\") " pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 09 00:00:17.660887 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.660807 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hgn2x\"" Jun 09 00:00:17.662918 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.662902 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7m2rg" Jun 09 00:00:17.668638 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.668602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 09 00:00:17.786401 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.786374 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7m2rg"] Jun 09 00:00:17.789672 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:00:17.789637 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3d4ab4_dde7_44e8_ac52_6c70c0f2a761.slice/crio-df122e0c36066867711b11b0d3745fb3220fa621454d310cbed061089f2e5731 WatchSource:0}: Error finding container df122e0c36066867711b11b0d3745fb3220fa621454d310cbed061089f2e5731: Status 404 returned error can't find the container with id df122e0c36066867711b11b0d3745fb3220fa621454d310cbed061089f2e5731 Jun 09 00:00:17.801690 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.801669 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-85zlm"] Jun 09 00:00:17.804537 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:00:17.804516 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2caa6272_6c5d_436e_833c_3c91d309e350.slice/crio-a306abd6c6af08941f08d1ebfe4c4b5477b681da5c3b7dd813d761d10917d9b5 WatchSource:0}: Error finding container a306abd6c6af08941f08d1ebfe4c4b5477b681da5c3b7dd813d761d10917d9b5: Status 404 returned error can't find the container with id a306abd6c6af08941f08d1ebfe4c4b5477b681da5c3b7dd813d761d10917d9b5 Jun 09 00:00:17.864973 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.864941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 09 00:00:17.865089 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:00:17.865058 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:17.865138 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:00:17.865107 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-09 00:00:49.865093054 +0000 UTC m=+98.687194596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 09 00:00:17.937669 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.937580 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-85zlm" event={"ID":"2caa6272-6c5d-436e-833c-3c91d309e350","Type":"ContainerStarted","Data":"a306abd6c6af08941f08d1ebfe4c4b5477b681da5c3b7dd813d761d10917d9b5"} Jun 09 00:00:17.938629 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:17.938589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7m2rg" event={"ID":"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761","Type":"ContainerStarted","Data":"df122e0c36066867711b11b0d3745fb3220fa621454d310cbed061089f2e5731"} Jun 09 00:00:22.954412 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:22.954369 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7m2rg" event={"ID":"9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761","Type":"ContainerStarted","Data":"5f721df305ccfcd602e2590468b826d55b735e77c286efcba3cb34f54a882a97"} Jun 09 00:00:22.955725 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:22.955704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-85zlm" event={"ID":"2caa6272-6c5d-436e-833c-3c91d309e350","Type":"ContainerStarted","Data":"afe29808383872e04c3fb282110062efd6f7ca8f204336e66cc5bde24b8893c5"} Jun 09 00:00:22.955846 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:22.955830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 09 00:00:22.968160 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:22.968119 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7m2rg" podStartSLOduration=67.298503226 podStartE2EDuration="1m11.968093931s" totalImagesPullingTime="4.669590705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:22.967546016 +0000 UTC m=+71.789647578" watchObservedRunningTime="2026-06-09 00:00:22.968093931 +0000 UTC m=+71.790195488" Jun 09 00:00:22.980815 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:22.980775 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-85zlm" podStartSLOduration=67.327191248 podStartE2EDuration="1m11.980765053s" totalImagesPullingTime="4.653573805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:22.980087969 +0000 UTC m=+71.802189534" watchObservedRunningTime="2026-06-09 00:00:22.980765053 +0000 UTC m=+71.802866615" Jun 09 00:00:49.875657 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:49.875600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 09 00:00:49.876024 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:00:49.875756 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:49.876024 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:00:49.875819 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-09 00:01:53.875803443 +0000 UTC m=+162.697904984 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 09 00:00:53.961017 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:00:53.960987 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-85zlm" Jun 09 00:01:21.484312 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:01:21.484261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 09 00:01:21.484743 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:01:21.484381 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:01:21.484743 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:01:21.484444 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs podName:3ef5d3ff-9832-4b60-a130-8a41f6585f52 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:23.484428569 +0000 UTC m=+252.306530111 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs") pod "network-metrics-daemon-vbs7g" (UID: "3ef5d3ff-9832-4b60-a130-8a41f6585f52") : secret "metrics-daemon-secret" not found Jun 09 00:01:49.073261 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:01:49.073222 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ddnnc" podUID="b40303a4-7e13-473f-9044-3c77f276f2fd" Jun 09 00:01:49.160366 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:01:49.160337 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ddnnc" Jun 09 00:01:50.650264 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:01:50.650221 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vbs7g" podUID="3ef5d3ff-9832-4b60-a130-8a41f6585f52" Jun 09 00:01:53.902287 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:01:53.902196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 09 00:01:53.902661 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:01:53.902303 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:01:53.902661 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:01:53.902361 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls podName:b40303a4-7e13-473f-9044-3c77f276f2fd nodeName:}" failed. No retries permitted until 2026-06-09 00:03:55.902347787 +0000 UTC m=+284.724449329 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls") pod "dns-default-ddnnc" (UID: "b40303a4-7e13-473f-9044-3c77f276f2fd") : secret "dns-default-metrics-tls" not found Jun 09 00:02:02.637777 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:02.637748 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 09 00:02:47.872558 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.872524 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7"] Jun 09 00:02:47.874128 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.874112 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-586fd994d5-9xrfl"] Jun 09 00:02:47.874243 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.874223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:47.875802 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.875778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.876997 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.876981 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:02:47.876997 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.876993 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 00:02:47.877272 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.877255 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 00:02:47.877649 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.877635 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hqrqw\"" Jun 09 00:02:47.878410 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.878396 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 00:02:47.878478 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.878399 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 00:02:47.878930 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.878918 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 00:02:47.878994 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.878934 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cn964\"" Jun 09 00:02:47.888011 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.887988 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 00:02:47.891225 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.891202 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7"] Jun 09 00:02:47.909026 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.909004 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-586fd994d5-9xrfl"] Jun 09 00:02:47.942295 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-installation-pull-secrets\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.942430 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wrv\" (UniqueName: \"kubernetes.io/projected/14507474-892c-4959-8641-e7ea3debd1db-kube-api-access-k5wrv\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:47.942430 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-image-registry-private-configuration\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.942430 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzlcf\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-kube-api-access-jzlcf\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.942430 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-registry-certificates\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.942603 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.942603 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33459e49-5e73-4216-ae9d-e6d868694063-ca-trust-extracted\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.942603 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-trusted-ca\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.942603 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942583 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-bound-sa-token\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:47.942781 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.942651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:47.965982 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.965956 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb"] Jun 09 00:02:47.967629 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.967603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb" Jun 09 00:02:47.969110 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.969082 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n"] Jun 09 00:02:47.970062 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.970045 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-n8s5j\"" Jun 09 00:02:47.970758 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.970743 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg"] Jun 09 00:02:47.970869 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.970854 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:47.972396 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.972380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:47.973162 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.973145 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 00:02:47.973713 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.973698 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-chz52\"" Jun 09 00:02:47.974075 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.974059 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 00:02:47.974472 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.974457 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 00:02:47.975015 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.974820 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 00:02:47.976008 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.975975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lpl2w\"" Jun 09 00:02:47.976111 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.976013 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 00:02:47.976111 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.976031 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 00:02:47.977343 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.977324 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb"] Jun 09 00:02:47.985978 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.985961 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n"] Jun 09 00:02:47.987096 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:47.987073 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg"] Jun 09 00:02:48.043681 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33459e49-5e73-4216-ae9d-e6d868694063-ca-trust-extracted\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.043795 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-trusted-ca\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.043795 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.043795 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:48.043795 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-bound-sa-token\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.043795 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57a995c9-bcac-4085-9d93-4dcb7d2e5249-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:48.044023 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tvl5\" (UniqueName: \"kubernetes.io/projected/18e4044a-9fb7-44d5-a8da-4490139627e5-kube-api-access-4tvl5\") pod \"network-check-source-dbd9cf844-j2ptb\" (UID: \"18e4044a-9fb7-44d5-a8da-4490139627e5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb" Jun 09 00:02:48.044023 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:48.044023 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdzm6\" (UniqueName: \"kubernetes.io/projected/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-kube-api-access-xdzm6\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.044023 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-installation-pull-secrets\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.044023 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.043927 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 00:02:48.044023 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.043970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wrv\" (UniqueName: \"kubernetes.io/projected/14507474-892c-4959-8641-e7ea3debd1db-kube-api-access-k5wrv\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:48.044023 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.043990 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls podName:14507474-892c-4959-8641-e7ea3debd1db nodeName:}" failed. No retries permitted until 2026-06-09 00:02:48.543971602 +0000 UTC m=+217.366073157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-phdp7" (UID: "14507474-892c-4959-8641-e7ea3debd1db") : secret "samples-operator-tls" not found Jun 09 00:02:48.044023 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.044013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.044393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.044037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-image-registry-private-configuration\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.044393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.044041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33459e49-5e73-4216-ae9d-e6d868694063-ca-trust-extracted\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.044393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.044059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzlcf\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-kube-api-access-jzlcf\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.044393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.044087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-registry-certificates\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.044393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.044130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.044393 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.044224 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:02:48.044393 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.044238 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586fd994d5-9xrfl: secret "image-registry-tls" not found Jun 09 00:02:48.044393 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.044291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls podName:33459e49-5e73-4216-ae9d-e6d868694063 nodeName:}" failed. No retries permitted until 2026-06-09 00:02:48.544276023 +0000 UTC m=+217.366377577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls") pod "image-registry-586fd994d5-9xrfl" (UID: "33459e49-5e73-4216-ae9d-e6d868694063") : secret "image-registry-tls" not found Jun 09 00:02:48.044768 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.044639 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-registry-certificates\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.044768 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.044647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-trusted-ca\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.046115 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.046100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-installation-pull-secrets\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.046192 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.046174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-image-registry-private-configuration\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.053749 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.053730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-bound-sa-token\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.053850 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.053792 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzlcf\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-kube-api-access-jzlcf\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.054432 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.054414 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wrv\" (UniqueName: \"kubernetes.io/projected/14507474-892c-4959-8641-e7ea3debd1db-kube-api-access-k5wrv\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:48.144876 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.144816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57a995c9-bcac-4085-9d93-4dcb7d2e5249-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:48.144876 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.144848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tvl5\" (UniqueName: \"kubernetes.io/projected/18e4044a-9fb7-44d5-a8da-4490139627e5-kube-api-access-4tvl5\") pod \"network-check-source-dbd9cf844-j2ptb\" (UID: \"18e4044a-9fb7-44d5-a8da-4490139627e5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb" Jun 09 00:02:48.145027 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.144886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdzm6\" (UniqueName: \"kubernetes.io/projected/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-kube-api-access-xdzm6\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.145027 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.144930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.145027 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.145005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.145184 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.145031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:48.145184 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.145123 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 00:02:48.145288 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.145186 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert podName:57a995c9-bcac-4085-9d93-4dcb7d2e5249 nodeName:}" failed. No retries permitted until 2026-06-09 00:02:48.645168862 +0000 UTC m=+217.467270404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2qz5n" (UID: "57a995c9-bcac-4085-9d93-4dcb7d2e5249") : secret "networking-console-plugin-cert" not found Jun 09 00:02:48.145288 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.145125 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:48.145288 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.145264 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls podName:519e81cd-4cb5-4ffb-9f67-c7a919f7393b nodeName:}" failed. No retries permitted until 2026-06-09 00:02:48.645250439 +0000 UTC m=+217.467351979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vcslg" (UID: "519e81cd-4cb5-4ffb-9f67-c7a919f7393b") : secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:48.145526 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.145507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57a995c9-bcac-4085-9d93-4dcb7d2e5249-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:48.145751 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.145732 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.155219 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.155198 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tvl5\" (UniqueName: \"kubernetes.io/projected/18e4044a-9fb7-44d5-a8da-4490139627e5-kube-api-access-4tvl5\") pod \"network-check-source-dbd9cf844-j2ptb\" (UID: \"18e4044a-9fb7-44d5-a8da-4490139627e5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb" Jun 09 00:02:48.155321 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.155201 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdzm6\" (UniqueName: \"kubernetes.io/projected/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-kube-api-access-xdzm6\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.278454 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.278410 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb" Jun 09 00:02:48.391694 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.391661 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb"] Jun 09 00:02:48.394861 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:02:48.394832 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e4044a_9fb7_44d5_a8da_4490139627e5.slice/crio-02191e6a9de839db0d79f1821c5a732858f7c089026d45c91ac122d1ff9bfe52 WatchSource:0}: Error finding container 02191e6a9de839db0d79f1821c5a732858f7c089026d45c91ac122d1ff9bfe52: Status 404 returned error can't find the container with id 02191e6a9de839db0d79f1821c5a732858f7c089026d45c91ac122d1ff9bfe52 Jun 09 00:02:48.547872 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.547838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:48.548028 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.547926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:48.548028 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.548000 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 00:02:48.548137 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.548054 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:02:48.548137 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.548071 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586fd994d5-9xrfl: secret "image-registry-tls" not found Jun 09 00:02:48.548137 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.548072 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls podName:14507474-892c-4959-8641-e7ea3debd1db nodeName:}" failed. No retries permitted until 2026-06-09 00:02:49.548050596 +0000 UTC m=+218.370152141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-phdp7" (UID: "14507474-892c-4959-8641-e7ea3debd1db") : secret "samples-operator-tls" not found Jun 09 00:02:48.548137 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.548117 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls podName:33459e49-5e73-4216-ae9d-e6d868694063 nodeName:}" failed. No retries permitted until 2026-06-09 00:02:49.548103179 +0000 UTC m=+218.370204720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls") pod "image-registry-586fd994d5-9xrfl" (UID: "33459e49-5e73-4216-ae9d-e6d868694063") : secret "image-registry-tls" not found Jun 09 00:02:48.648591 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.648500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:48.648591 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:48.648547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:48.648794 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.648658 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:48.648794 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.648670 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 00:02:48.648794 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.648720 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls podName:519e81cd-4cb5-4ffb-9f67-c7a919f7393b nodeName:}" failed. No retries permitted until 2026-06-09 00:02:49.648705344 +0000 UTC m=+218.470806885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vcslg" (UID: "519e81cd-4cb5-4ffb-9f67-c7a919f7393b") : secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:48.648794 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:48.648735 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert podName:57a995c9-bcac-4085-9d93-4dcb7d2e5249 nodeName:}" failed. No retries permitted until 2026-06-09 00:02:49.648727484 +0000 UTC m=+218.470829024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2qz5n" (UID: "57a995c9-bcac-4085-9d93-4dcb7d2e5249") : secret "networking-console-plugin-cert" not found Jun 09 00:02:49.307942 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:49.307910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb" event={"ID":"18e4044a-9fb7-44d5-a8da-4490139627e5","Type":"ContainerStarted","Data":"bddd51d1364d4822ef338eafac9e8e58cbbe699ca9fa11a5c3b1341f28afeb7f"} Jun 09 00:02:49.308274 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:49.307957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb" event={"ID":"18e4044a-9fb7-44d5-a8da-4490139627e5","Type":"ContainerStarted","Data":"02191e6a9de839db0d79f1821c5a732858f7c089026d45c91ac122d1ff9bfe52"} Jun 09 00:02:49.322296 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:49.322243 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-j2ptb" podStartSLOduration=2.322227136 podStartE2EDuration="2.322227136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:02:49.321890168 +0000 UTC m=+218.143991729" watchObservedRunningTime="2026-06-09 00:02:49.322227136 +0000 UTC m=+218.144328699" Jun 09 00:02:49.555927 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:49.555890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:49.556099 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:49.555993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:49.556099 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.556026 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:02:49.556099 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.556047 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586fd994d5-9xrfl: secret "image-registry-tls" not found Jun 09 00:02:49.556099 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.556101 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls podName:33459e49-5e73-4216-ae9d-e6d868694063 nodeName:}" failed. No retries permitted until 2026-06-09 00:02:51.556086456 +0000 UTC m=+220.378187997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls") pod "image-registry-586fd994d5-9xrfl" (UID: "33459e49-5e73-4216-ae9d-e6d868694063") : secret "image-registry-tls" not found Jun 09 00:02:49.556256 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.556119 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 00:02:49.556256 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.556168 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls podName:14507474-892c-4959-8641-e7ea3debd1db nodeName:}" failed. No retries permitted until 2026-06-09 00:02:51.556152089 +0000 UTC m=+220.378253634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-phdp7" (UID: "14507474-892c-4959-8641-e7ea3debd1db") : secret "samples-operator-tls" not found Jun 09 00:02:49.656488 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:49.656413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:49.656488 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:49.656443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:49.656717 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.656546 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 00:02:49.656717 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.656562 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:49.656717 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.656593 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert podName:57a995c9-bcac-4085-9d93-4dcb7d2e5249 nodeName:}" failed. No retries permitted until 2026-06-09 00:02:51.656581045 +0000 UTC m=+220.478682585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2qz5n" (UID: "57a995c9-bcac-4085-9d93-4dcb7d2e5249") : secret "networking-console-plugin-cert" not found Jun 09 00:02:49.656717 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:49.656635 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls podName:519e81cd-4cb5-4ffb-9f67-c7a919f7393b nodeName:}" failed. No retries permitted until 2026-06-09 00:02:51.656601143 +0000 UTC m=+220.478702683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vcslg" (UID: "519e81cd-4cb5-4ffb-9f67-c7a919f7393b") : secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:51.568824 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:51.568789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:51.569242 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:51.568863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:51.569242 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.568941 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:02:51.569242 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.568957 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586fd994d5-9xrfl: secret "image-registry-tls" not found Jun 09 00:02:51.569242 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.568965 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 00:02:51.569242 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.569012 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls podName:14507474-892c-4959-8641-e7ea3debd1db nodeName:}" failed. No retries permitted until 2026-06-09 00:02:55.568999974 +0000 UTC m=+224.391101518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-phdp7" (UID: "14507474-892c-4959-8641-e7ea3debd1db") : secret "samples-operator-tls" not found Jun 09 00:02:51.569242 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.569026 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls podName:33459e49-5e73-4216-ae9d-e6d868694063 nodeName:}" failed. No retries permitted until 2026-06-09 00:02:55.569020522 +0000 UTC m=+224.391122065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls") pod "image-registry-586fd994d5-9xrfl" (UID: "33459e49-5e73-4216-ae9d-e6d868694063") : secret "image-registry-tls" not found Jun 09 00:02:51.670182 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:51.670154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:51.670182 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:51.670181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:51.670365 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.670284 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:51.670365 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.670313 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 00:02:51.670365 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.670334 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls podName:519e81cd-4cb5-4ffb-9f67-c7a919f7393b nodeName:}" failed. No retries permitted until 2026-06-09 00:02:55.670322345 +0000 UTC m=+224.492423885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vcslg" (UID: "519e81cd-4cb5-4ffb-9f67-c7a919f7393b") : secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:51.670365 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:51.670352 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert podName:57a995c9-bcac-4085-9d93-4dcb7d2e5249 nodeName:}" failed. No retries permitted until 2026-06-09 00:02:55.670342312 +0000 UTC m=+224.492443853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2qz5n" (UID: "57a995c9-bcac-4085-9d93-4dcb7d2e5249") : secret "networking-console-plugin-cert" not found Jun 09 00:02:53.870669 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:53.870642 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs"] Jun 09 00:02:53.873480 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:53.873465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" Jun 09 00:02:53.875792 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:53.875759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 00:02:53.875918 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:53.875881 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-f7zwh\"" Jun 09 00:02:53.876879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:53.876861 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 00:02:53.882314 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:53.882294 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs"] Jun 09 00:02:53.987834 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:53.987810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r54x\" (UniqueName: \"kubernetes.io/projected/32149b1c-d653-4e7a-adc8-21a7625d3ae8-kube-api-access-2r54x\") pod \"migrator-955ffdf5f-572fs\" (UID: \"32149b1c-d653-4e7a-adc8-21a7625d3ae8\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" Jun 09 00:02:54.088537 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:54.088509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r54x\" (UniqueName: \"kubernetes.io/projected/32149b1c-d653-4e7a-adc8-21a7625d3ae8-kube-api-access-2r54x\") pod \"migrator-955ffdf5f-572fs\" (UID: \"32149b1c-d653-4e7a-adc8-21a7625d3ae8\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" Jun 09 00:02:54.098028 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:54.098004 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r54x\" (UniqueName: \"kubernetes.io/projected/32149b1c-d653-4e7a-adc8-21a7625d3ae8-kube-api-access-2r54x\") pod \"migrator-955ffdf5f-572fs\" (UID: \"32149b1c-d653-4e7a-adc8-21a7625d3ae8\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" Jun 09 00:02:54.182116 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:54.182061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" Jun 09 00:02:54.294038 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:54.294017 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs"] Jun 09 00:02:54.296488 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:02:54.296458 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32149b1c_d653_4e7a_adc8_21a7625d3ae8.slice/crio-d784f5898bdf8d75320854251f9faf49520c0fce0f26f9f8743395ebbd1feb18 WatchSource:0}: Error finding container d784f5898bdf8d75320854251f9faf49520c0fce0f26f9f8743395ebbd1feb18: Status 404 returned error can't find the container with id d784f5898bdf8d75320854251f9faf49520c0fce0f26f9f8743395ebbd1feb18 Jun 09 00:02:54.323988 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:54.323964 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" event={"ID":"32149b1c-d653-4e7a-adc8-21a7625d3ae8","Type":"ContainerStarted","Data":"d784f5898bdf8d75320854251f9faf49520c0fce0f26f9f8743395ebbd1feb18"} Jun 09 00:02:55.597974 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:55.597933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:02:55.598372 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:55.598012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:02:55.598372 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.598096 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:02:55.598372 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.598117 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586fd994d5-9xrfl: secret "image-registry-tls" not found Jun 09 00:02:55.598372 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.598116 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 00:02:55.598372 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.598174 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls podName:33459e49-5e73-4216-ae9d-e6d868694063 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:03.598159019 +0000 UTC m=+232.420260559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls") pod "image-registry-586fd994d5-9xrfl" (UID: "33459e49-5e73-4216-ae9d-e6d868694063") : secret "image-registry-tls" not found Jun 09 00:02:55.598372 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.598189 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls podName:14507474-892c-4959-8641-e7ea3debd1db nodeName:}" failed. No retries permitted until 2026-06-09 00:03:03.598182534 +0000 UTC m=+232.420284074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-phdp7" (UID: "14507474-892c-4959-8641-e7ea3debd1db") : secret "samples-operator-tls" not found Jun 09 00:02:55.698478 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:55.698440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:02:55.698478 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:55.698482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:02:55.698685 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.698592 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:55.698685 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.698654 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 00:02:55.698685 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.698665 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls podName:519e81cd-4cb5-4ffb-9f67-c7a919f7393b nodeName:}" failed. No retries permitted until 2026-06-09 00:03:03.698645676 +0000 UTC m=+232.520747223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vcslg" (UID: "519e81cd-4cb5-4ffb-9f67-c7a919f7393b") : secret "cluster-monitoring-operator-tls" not found Jun 09 00:02:55.698790 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:02:55.698701 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert podName:57a995c9-bcac-4085-9d93-4dcb7d2e5249 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:03.698689098 +0000 UTC m=+232.520790642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2qz5n" (UID: "57a995c9-bcac-4085-9d93-4dcb7d2e5249") : secret "networking-console-plugin-cert" not found Jun 09 00:02:56.331090 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:56.331060 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" event={"ID":"32149b1c-d653-4e7a-adc8-21a7625d3ae8","Type":"ContainerStarted","Data":"829243416d5867c5a755e59d440f69b8e1a148d4b53fc50776f67198c9055a35"} Jun 09 00:02:56.331334 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:56.331115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" event={"ID":"32149b1c-d653-4e7a-adc8-21a7625d3ae8","Type":"ContainerStarted","Data":"8f881c89c287eedc40d8f63ece955050da37f6204934434aa36b05b8405d44cf"} Jun 09 00:02:56.348099 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:56.348058 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-572fs" podStartSLOduration=1.927180104 podStartE2EDuration="3.348033341s" totalImagesPullingTime="1.420853237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:02:56.346903335 +0000 UTC m=+225.169004890" watchObservedRunningTime="2026-06-09 00:02:56.348033341 +0000 UTC m=+225.170134903" Jun 09 00:02:56.726879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:56.726787 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whcbr_f43a7ef4-2b19-4359-880d-e0a37348fe36/dns-node-resolver/0.log" Jun 09 00:02:57.126935 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:57.126908 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29682720-p5shc_552b6253-8d86-4fcf-a2d6-3e77dcea0700/image-pruner/0.log" Jun 09 00:02:57.926401 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:57.926375 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8zk8_9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4/node-ca/0.log" Jun 09 00:02:58.526272 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:58.526247 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6dk5_01aec00e-ba0c-4439-af7d-cfd67a3cf234/serve-healthcheck-canary/0.log" Jun 09 00:02:59.126501 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:59.126475 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-572fs_32149b1c-d653-4e7a-adc8-21a7625d3ae8/migrator/0.log" Jun 09 00:02:59.326509 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:02:59.326483 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-572fs_32149b1c-d653-4e7a-adc8-21a7625d3ae8/graceful-termination/0.log" Jun 09 00:03:03.659891 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.659864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:03:03.660268 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.659926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:03:03.662263 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.662229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"image-registry-586fd994d5-9xrfl\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:03:03.662389 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.662366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/14507474-892c-4959-8641-e7ea3debd1db-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-phdp7\" (UID: \"14507474-892c-4959-8641-e7ea3debd1db\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:03:03.760254 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.760216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:03:03.760254 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.760257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:03:03.760448 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:03.760357 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 00:03:03.760448 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:03.760430 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls podName:519e81cd-4cb5-4ffb-9f67-c7a919f7393b nodeName:}" failed. No retries permitted until 2026-06-09 00:03:19.760415387 +0000 UTC m=+248.582516929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vcslg" (UID: "519e81cd-4cb5-4ffb-9f67-c7a919f7393b") : secret "cluster-monitoring-operator-tls" not found Jun 09 00:03:03.760448 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:03.760364 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 00:03:03.760555 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:03.760497 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert podName:57a995c9-bcac-4085-9d93-4dcb7d2e5249 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:19.760481206 +0000 UTC m=+248.582582748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2qz5n" (UID: "57a995c9-bcac-4085-9d93-4dcb7d2e5249") : secret "networking-console-plugin-cert" not found Jun 09 00:03:03.785203 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.785178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" Jun 09 00:03:03.791248 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.791223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:03:03.915284 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.915214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7"] Jun 09 00:03:03.930831 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:03.930802 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-586fd994d5-9xrfl"] Jun 09 00:03:03.933597 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:03.933571 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33459e49_5e73_4216_ae9d_e6d868694063.slice/crio-34ce2b8df437ba5b081da7bf4c42e38d3efd80c6b76c934d57b257476058e24a WatchSource:0}: Error finding container 34ce2b8df437ba5b081da7bf4c42e38d3efd80c6b76c934d57b257476058e24a: Status 404 returned error can't find the container with id 34ce2b8df437ba5b081da7bf4c42e38d3efd80c6b76c934d57b257476058e24a Jun 09 00:03:04.355099 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:04.355059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" event={"ID":"33459e49-5e73-4216-ae9d-e6d868694063","Type":"ContainerStarted","Data":"941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7"} Jun 09 00:03:04.355288 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:04.355124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" event={"ID":"33459e49-5e73-4216-ae9d-e6d868694063","Type":"ContainerStarted","Data":"34ce2b8df437ba5b081da7bf4c42e38d3efd80c6b76c934d57b257476058e24a"} Jun 09 00:03:04.355288 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:04.355151 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:03:04.356231 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:04.356209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" event={"ID":"14507474-892c-4959-8641-e7ea3debd1db","Type":"ContainerStarted","Data":"ceb875847f47aab9c6b8f8b69ac37ac52e84a8920bb5818edbd87e44e8a27718"} Jun 09 00:03:04.373472 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:04.373407 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" podStartSLOduration=17.373393251 podStartE2EDuration="17.373393251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:04.372236478 +0000 UTC m=+233.194338041" watchObservedRunningTime="2026-06-09 00:03:04.373393251 +0000 UTC m=+233.195494814" Jun 09 00:03:06.365059 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:06.365025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" event={"ID":"14507474-892c-4959-8641-e7ea3debd1db","Type":"ContainerStarted","Data":"069e6d6b050b3a0445789fa0bef9d683bae3259c35db5befde6b555f402f440e"} Jun 09 00:03:06.365546 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:06.365086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" event={"ID":"14507474-892c-4959-8641-e7ea3debd1db","Type":"ContainerStarted","Data":"a9a09c19c1f2d13e527efe7ffceeb0678a7f35b2e24f60c80001bfc33625f1e7"} Jun 09 00:03:06.380555 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:06.380510 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-phdp7" podStartSLOduration=17.466199721 podStartE2EDuration="19.380493842s" totalImagesPullingTime="1.914294121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:06.379013572 +0000 UTC m=+235.201115137" watchObservedRunningTime="2026-06-09 00:03:06.380493842 +0000 UTC m=+235.202595405" Jun 09 00:03:14.646832 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.646799 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lx4nn"] Jun 09 00:03:14.651541 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.651518 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.653948 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.653926 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 00:03:14.655137 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.655116 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 00:03:14.655265 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.655243 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rvkn7\"" Jun 09 00:03:14.655312 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.655268 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 00:03:14.655312 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.655279 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 00:03:14.659517 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.659495 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lx4nn"] Jun 09 00:03:14.684996 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.684974 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-586fd994d5-9xrfl"] Jun 09 00:03:14.719001 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.718978 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b8bbc66c7-2sq9n"] Jun 09 00:03:14.722011 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.721995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.732542 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.732523 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b8bbc66c7-2sq9n"] Jun 09 00:03:14.740702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.740683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.740787 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.740711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-crio-socket\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.740787 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.740731 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.740787 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.740760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlcp2\" (UniqueName: \"kubernetes.io/projected/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-kube-api-access-qlcp2\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.740939 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.740881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-data-volume\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.841668 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlcp2\" (UniqueName: \"kubernetes.io/projected/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-kube-api-access-qlcp2\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.841801 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62f4d32e-c86f-440f-a035-eeec5c4f50da-trusted-ca\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.841801 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-data-volume\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.841801 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xspnn\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-kube-api-access-xspnn\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.841801 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62f4d32e-c86f-440f-a035-eeec5c4f50da-image-registry-private-configuration\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.841801 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62f4d32e-c86f-440f-a035-eeec5c4f50da-installation-pull-secrets\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.841976 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62f4d32e-c86f-440f-a035-eeec5c4f50da-ca-trust-extracted\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.841976 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.841976 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62f4d32e-c86f-440f-a035-eeec5c4f50da-registry-certificates\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.841976 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-crio-socket\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.841976 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-registry-tls\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.842143 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.841994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-bound-sa-token\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.842143 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.842032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.842143 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.842002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-crio-socket\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.842143 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.842093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-data-volume\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.842309 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.842290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.844226 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.844201 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.849501 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.849483 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlcp2\" (UniqueName: \"kubernetes.io/projected/eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce-kube-api-access-qlcp2\") pod \"insights-runtime-extractor-lx4nn\" (UID: \"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce\") " pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:14.942433 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62f4d32e-c86f-440f-a035-eeec5c4f50da-ca-trust-extracted\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.942433 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62f4d32e-c86f-440f-a035-eeec5c4f50da-registry-certificates\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.942568 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-registry-tls\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.942568 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-bound-sa-token\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.942568 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62f4d32e-c86f-440f-a035-eeec5c4f50da-trusted-ca\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.942568 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xspnn\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-kube-api-access-xspnn\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.942763 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62f4d32e-c86f-440f-a035-eeec5c4f50da-image-registry-private-configuration\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.942763 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62f4d32e-c86f-440f-a035-eeec5c4f50da-installation-pull-secrets\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.942861 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.942840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62f4d32e-c86f-440f-a035-eeec5c4f50da-ca-trust-extracted\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.943507 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.943482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62f4d32e-c86f-440f-a035-eeec5c4f50da-registry-certificates\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.943598 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.943530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62f4d32e-c86f-440f-a035-eeec5c4f50da-trusted-ca\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.944901 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.944879 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-registry-tls\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.944966 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.944882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62f4d32e-c86f-440f-a035-eeec5c4f50da-installation-pull-secrets\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.945027 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.945011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62f4d32e-c86f-440f-a035-eeec5c4f50da-image-registry-private-configuration\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.949546 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.949525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-bound-sa-token\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.949999 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.949979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xspnn\" (UniqueName: \"kubernetes.io/projected/62f4d32e-c86f-440f-a035-eeec5c4f50da-kube-api-access-xspnn\") pod \"image-registry-b8bbc66c7-2sq9n\" (UID: \"62f4d32e-c86f-440f-a035-eeec5c4f50da\") " pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:14.960718 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:14.960699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lx4nn" Jun 09 00:03:15.030408 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.030331 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:15.099705 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.099678 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lx4nn"] Jun 09 00:03:15.102892 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:15.102870 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebf6bf8_356f_4e9d_b1ab_3f6819fd35ce.slice/crio-780b34f5296e29feccbf132b40bf2b4e4a92a6f29733005c7705d413b1eaa1a1 WatchSource:0}: Error finding container 780b34f5296e29feccbf132b40bf2b4e4a92a6f29733005c7705d413b1eaa1a1: Status 404 returned error can't find the container with id 780b34f5296e29feccbf132b40bf2b4e4a92a6f29733005c7705d413b1eaa1a1 Jun 09 00:03:15.156907 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.156886 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b8bbc66c7-2sq9n"] Jun 09 00:03:15.159750 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:15.159729 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f4d32e_c86f_440f_a035_eeec5c4f50da.slice/crio-16749dc70505e80543aed6a0f8ebb68b1e8a4bebab33858742db97b676f183f7 WatchSource:0}: Error finding container 16749dc70505e80543aed6a0f8ebb68b1e8a4bebab33858742db97b676f183f7: Status 404 returned error can't find the container with id 16749dc70505e80543aed6a0f8ebb68b1e8a4bebab33858742db97b676f183f7 Jun 09 00:03:15.395431 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.395394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" event={"ID":"62f4d32e-c86f-440f-a035-eeec5c4f50da","Type":"ContainerStarted","Data":"6da40d5063fd39c19edf87694241846dc20d2dec9fe8575a4b5166ea61ede578"} Jun 09 00:03:15.395642 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.395455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" event={"ID":"62f4d32e-c86f-440f-a035-eeec5c4f50da","Type":"ContainerStarted","Data":"16749dc70505e80543aed6a0f8ebb68b1e8a4bebab33858742db97b676f183f7"} Jun 09 00:03:15.395642 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.395485 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:15.396833 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.396812 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx4nn" event={"ID":"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce","Type":"ContainerStarted","Data":"fbcc4948bfc8504227e62f28b5777eb5a174fde5e957b2711adfc31365e4ec49"} Jun 09 00:03:15.396930 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.396852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx4nn" event={"ID":"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce","Type":"ContainerStarted","Data":"780b34f5296e29feccbf132b40bf2b4e4a92a6f29733005c7705d413b1eaa1a1"} Jun 09 00:03:15.414225 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:15.414120 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podStartSLOduration=1.4141046290000001 podStartE2EDuration="1.414104629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:15.413574288 +0000 UTC m=+244.235675863" watchObservedRunningTime="2026-06-09 00:03:15.414104629 +0000 UTC m=+244.236206187" Jun 09 00:03:16.402628 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:16.402577 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx4nn" event={"ID":"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce","Type":"ContainerStarted","Data":"95a842d139652663b916747974fbe09bf1a8c69f3eea4ca7252618e0608a77ff"} Jun 09 00:03:18.410789 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:18.410746 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx4nn" event={"ID":"eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce","Type":"ContainerStarted","Data":"f8eaa39ac9fd313ad460bff3a4e5fb4cdaec71d2500f8fb28d88e2e20b2795fe"} Jun 09 00:03:18.427591 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:18.427543 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lx4nn" podStartSLOduration=2.17039177 podStartE2EDuration="4.427528651s" totalImagesPullingTime="2.257136881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:03:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:18.426792237 +0000 UTC m=+247.248893792" watchObservedRunningTime="2026-06-09 00:03:18.427528651 +0000 UTC m=+247.249630214" Jun 09 00:03:19.780437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.780397 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:03:19.780437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.780445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:03:19.782914 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.782892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57a995c9-bcac-4085-9d93-4dcb7d2e5249-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2qz5n\" (UID: \"57a995c9-bcac-4085-9d93-4dcb7d2e5249\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:03:19.783018 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.782897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/519e81cd-4cb5-4ffb-9f67-c7a919f7393b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vcslg\" (UID: \"519e81cd-4cb5-4ffb-9f67-c7a919f7393b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:03:19.787076 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.787055 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-chz52\"" Jun 09 00:03:19.792366 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.792348 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lpl2w\"" Jun 09 00:03:19.795099 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.795086 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" Jun 09 00:03:19.800919 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.800903 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" Jun 09 00:03:19.925591 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.925561 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n"] Jun 09 00:03:19.929677 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:19.929643 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a995c9_bcac_4085_9d93_4dcb7d2e5249.slice/crio-96658a6f43a97c4b1b2a9b1cfaaea5f749a0f0ba8a4afe3efd0bf13382eee00f WatchSource:0}: Error finding container 96658a6f43a97c4b1b2a9b1cfaaea5f749a0f0ba8a4afe3efd0bf13382eee00f: Status 404 returned error can't find the container with id 96658a6f43a97c4b1b2a9b1cfaaea5f749a0f0ba8a4afe3efd0bf13382eee00f Jun 09 00:03:19.941578 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:19.941557 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg"] Jun 09 00:03:19.944456 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:19.944437 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519e81cd_4cb5_4ffb_9f67_c7a919f7393b.slice/crio-a6dbef0bf0bf7472f8b33b9e6c031c4380aa113fc18ff2921ea25a987dec3ba9 WatchSource:0}: Error finding container a6dbef0bf0bf7472f8b33b9e6c031c4380aa113fc18ff2921ea25a987dec3ba9: Status 404 returned error can't find the container with id a6dbef0bf0bf7472f8b33b9e6c031c4380aa113fc18ff2921ea25a987dec3ba9 Jun 09 00:03:20.418672 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:20.418639 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" event={"ID":"519e81cd-4cb5-4ffb-9f67-c7a919f7393b","Type":"ContainerStarted","Data":"a6dbef0bf0bf7472f8b33b9e6c031c4380aa113fc18ff2921ea25a987dec3ba9"} Jun 09 00:03:20.419642 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:20.419623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" event={"ID":"57a995c9-bcac-4085-9d93-4dcb7d2e5249","Type":"ContainerStarted","Data":"96658a6f43a97c4b1b2a9b1cfaaea5f749a0f0ba8a4afe3efd0bf13382eee00f"} Jun 09 00:03:21.423783 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:21.423755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" event={"ID":"57a995c9-bcac-4085-9d93-4dcb7d2e5249","Type":"ContainerStarted","Data":"33c665c434566bc9e3b1c25aa21d2b866f36611f9bb72bb578cdc98e46b17d06"} Jun 09 00:03:21.438659 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:21.438562 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2qz5n" podStartSLOduration=33.016454204 podStartE2EDuration="34.438548112s" totalImagesPullingTime="1.422093908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:21.437091514 +0000 UTC m=+250.259193077" watchObservedRunningTime="2026-06-09 00:03:21.438548112 +0000 UTC m=+250.260649712" Jun 09 00:03:22.428736 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:22.428645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" event={"ID":"519e81cd-4cb5-4ffb-9f67-c7a919f7393b","Type":"ContainerStarted","Data":"108749eea5409629636348823cc73ef9d4f1250389e47fbc3df8a13112e7dbaf"} Jun 09 00:03:22.446960 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:22.446917 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vcslg" podStartSLOduration=33.371792479 podStartE2EDuration="35.446902448s" totalImagesPullingTime="2.075109969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:22.445955817 +0000 UTC m=+251.268057382" watchObservedRunningTime="2026-06-09 00:03:22.446902448 +0000 UTC m=+251.269004059" Jun 09 00:03:23.513580 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:23.513545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 09 00:03:23.515873 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:23.515841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef5d3ff-9832-4b60-a130-8a41f6585f52-metrics-certs\") pod \"network-metrics-daemon-vbs7g\" (UID: \"3ef5d3ff-9832-4b60-a130-8a41f6585f52\") " pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 09 00:03:23.640922 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:23.640893 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7v6c\"" Jun 09 00:03:23.648805 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:23.648788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbs7g" Jun 09 00:03:23.794634 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:23.794423 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vbs7g"] Jun 09 00:03:23.796905 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:23.796877 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef5d3ff_9832_4b60_a130_8a41f6585f52.slice/crio-60e20356bd44b6d07272910b2d33f0db1ef7e5ac5c6c2d866af10f0b4a48b062 WatchSource:0}: Error finding container 60e20356bd44b6d07272910b2d33f0db1ef7e5ac5c6c2d866af10f0b4a48b062: Status 404 returned error can't find the container with id 60e20356bd44b6d07272910b2d33f0db1ef7e5ac5c6c2d866af10f0b4a48b062 Jun 09 00:03:24.436008 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:24.435968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbs7g" event={"ID":"3ef5d3ff-9832-4b60-a130-8a41f6585f52","Type":"ContainerStarted","Data":"60e20356bd44b6d07272910b2d33f0db1ef7e5ac5c6c2d866af10f0b4a48b062"} Jun 09 00:03:24.692985 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:24.692903 2562 patch_prober.go:28] interesting pod/image-registry-586fd994d5-9xrfl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:03:24.692985 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:24.692966 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" podUID="33459e49-5e73-4216-ae9d-e6d868694063" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:03:25.441627 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:25.441573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbs7g" event={"ID":"3ef5d3ff-9832-4b60-a130-8a41f6585f52","Type":"ContainerStarted","Data":"c3dc7daee5779dbc15d90ca4cd2e34fbfac9cedeb81e5310aafc65f4a9fdb38e"} Jun 09 00:03:25.441820 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:25.441641 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbs7g" event={"ID":"3ef5d3ff-9832-4b60-a130-8a41f6585f52","Type":"ContainerStarted","Data":"ba3653c199dd8602bd15fbba11e22dd81b99c9cb5f3644c7e90928c095582c50"} Jun 09 00:03:25.457663 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:25.457597 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vbs7g" podStartSLOduration=253.599031975 podStartE2EDuration="4m14.457583558s" totalImagesPullingTime="858.551583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:25.455680386 +0000 UTC m=+254.277781948" watchObservedRunningTime="2026-06-09 00:03:25.457583558 +0000 UTC m=+254.279685156" Jun 09 00:03:28.908759 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.908719 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm"] Jun 09 00:03:28.912110 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.912088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:28.914868 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.914843 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 00:03:28.914868 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.914847 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 00:03:28.915028 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.914846 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rwxlm\"" Jun 09 00:03:28.916955 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.916936 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 00:03:28.917086 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.917071 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 00:03:28.923843 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.923821 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm"] Jun 09 00:03:28.933554 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.933534 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m22l8"] Jun 09 00:03:28.936676 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.936658 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:28.939077 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.939062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 00:03:28.939181 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.939066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 00:03:28.939181 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.939111 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g5hh8\"" Jun 09 00:03:28.939420 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:28.939405 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 00:03:29.056934 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.056899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-tls\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.056934 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.056934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942cf1e5-5383-4034-a525-7630f3f875c2-metrics-client-ca\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.057127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.056953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.057127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.057127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.057127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad5224f-e44d-473d-8034-bc1c7b56f667-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.057127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-textfile\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.057275 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.057275 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbsql\" (UniqueName: \"kubernetes.io/projected/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-api-access-vbsql\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.057275 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-sys\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.057275 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.057392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-root\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.057392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxkw4\" (UniqueName: \"kubernetes.io/projected/942cf1e5-5383-4034-a525-7630f3f875c2-kube-api-access-pxkw4\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.057392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ad5224f-e44d-473d-8034-bc1c7b56f667-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.057392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.057355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-wtmp\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.158834 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.158754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad5224f-e44d-473d-8034-bc1c7b56f667-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.158834 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.158792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-textfile\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.158834 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.158821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.158854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbsql\" (UniqueName: \"kubernetes.io/projected/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-api-access-vbsql\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.159091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.158873 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-sys\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.158890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.159091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.158931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-root\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.158953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxkw4\" (UniqueName: \"kubernetes.io/projected/942cf1e5-5383-4034-a525-7630f3f875c2-kube-api-access-pxkw4\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ad5224f-e44d-473d-8034-bc1c7b56f667-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.159384 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-wtmp\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159384 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-textfile\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159384 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-sys\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159384 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-tls\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159384 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942cf1e5-5383-4034-a525-7630f3f875c2-metrics-client-ca\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159384 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.159384 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159350 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-wtmp\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.159384 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.160106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.160106 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:29.159527 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 00:03:29.160106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ad5224f-e44d-473d-8034-bc1c7b56f667-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.160106 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:29.159634 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-tls podName:9ad5224f-e44d-473d-8034-bc1c7b56f667 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:29.659584604 +0000 UTC m=+258.481686161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-fwhmm" (UID: "9ad5224f-e44d-473d-8034-bc1c7b56f667") : secret "kube-state-metrics-tls" not found Jun 09 00:03:29.160106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159125 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/942cf1e5-5383-4034-a525-7630f3f875c2-root\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.160106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.159828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad5224f-e44d-473d-8034-bc1c7b56f667-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.160386 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.160255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942cf1e5-5383-4034-a525-7630f3f875c2-metrics-client-ca\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.160386 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.160341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.160662 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.160641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.161354 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.161326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.161705 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.161685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/942cf1e5-5383-4034-a525-7630f3f875c2-node-exporter-tls\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.161759 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.161708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.166260 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.166237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxkw4\" (UniqueName: \"kubernetes.io/projected/942cf1e5-5383-4034-a525-7630f3f875c2-kube-api-access-pxkw4\") pod \"node-exporter-m22l8\" (UID: \"942cf1e5-5383-4034-a525-7630f3f875c2\") " pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.166430 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.166412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbsql\" (UniqueName: \"kubernetes.io/projected/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-api-access-vbsql\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.244928 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.244901 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m22l8" Jun 09 00:03:29.257698 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:29.257670 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942cf1e5_5383_4034_a525_7630f3f875c2.slice/crio-daad054b0c0cf7962b502b4cb323e6fbcfda972dc2dad8517812296d8cba2572 WatchSource:0}: Error finding container daad054b0c0cf7962b502b4cb323e6fbcfda972dc2dad8517812296d8cba2572: Status 404 returned error can't find the container with id daad054b0c0cf7962b502b4cb323e6fbcfda972dc2dad8517812296d8cba2572 Jun 09 00:03:29.454761 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.454678 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m22l8" event={"ID":"942cf1e5-5383-4034-a525-7630f3f875c2","Type":"ContainerStarted","Data":"daad054b0c0cf7962b502b4cb323e6fbcfda972dc2dad8517812296d8cba2572"} Jun 09 00:03:29.663622 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.663572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.665877 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.665847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad5224f-e44d-473d-8034-bc1c7b56f667-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-fwhmm\" (UID: \"9ad5224f-e44d-473d-8034-bc1c7b56f667\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.826093 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.826058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" Jun 09 00:03:29.964033 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.963959 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm"] Jun 09 00:03:29.966825 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:29.966792 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad5224f_e44d_473d_8034_bc1c7b56f667.slice/crio-1abee589567c588647a276c0fe5aef2f94615adb18087432095c6d9a7fc5dc13 WatchSource:0}: Error finding container 1abee589567c588647a276c0fe5aef2f94615adb18087432095c6d9a7fc5dc13: Status 404 returned error can't find the container with id 1abee589567c588647a276c0fe5aef2f94615adb18087432095c6d9a7fc5dc13 Jun 09 00:03:29.968590 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.968567 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:03:29.973527 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.973508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:29.975771 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.975751 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 00:03:29.976079 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.976062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 00:03:29.976182 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.976142 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 00:03:29.976274 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.976236 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 00:03:29.976326 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.976288 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 00:03:29.976658 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.976640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 00:03:29.977330 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.977311 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 00:03:29.977393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.977343 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 00:03:29.977393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.977354 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vqr42\"" Jun 09 00:03:29.977492 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.977343 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 00:03:29.984335 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:29.984314 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:03:30.067304 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-config-out\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-config-volume\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-web-config\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067776 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067776 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067776 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067776 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067776 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067697 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lhlw\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-kube-api-access-5lhlw\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067776 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.067987 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.067794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.168516 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.168516 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-config-volume\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.168737 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.168737 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-web-config\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.168737 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.168737 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.168737 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.168737 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.169029 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.169029 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lhlw\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-kube-api-access-5lhlw\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.169029 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.169029 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.169029 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.168904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-config-out\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.169029 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:30.168950 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle podName:04be2ea1-ad7d-41c8-83a4-379b99351297 nodeName:}" failed. No retries permitted until 2026-06-09 00:03:30.66892692 +0000 UTC m=+259.491028492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297") : configmap references non-existent config key: ca-bundle.crt Jun 09 00:03:30.169502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.169445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.170468 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.170440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.175123 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.175026 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.175123 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.175026 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.176651 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.175666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-config-out\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.176651 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.175685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.176651 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.176296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.176651 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.176591 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.176928 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.176665 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-config-volume\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.177208 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.177185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-web-config\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.177757 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.177737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.179228 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.179207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lhlw\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-kube-api-access-5lhlw\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.459203 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.459176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" event={"ID":"9ad5224f-e44d-473d-8034-bc1c7b56f667","Type":"ContainerStarted","Data":"1abee589567c588647a276c0fe5aef2f94615adb18087432095c6d9a7fc5dc13"} Jun 09 00:03:30.460663 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.460641 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m22l8" event={"ID":"942cf1e5-5383-4034-a525-7630f3f875c2","Type":"ContainerStarted","Data":"932500f80173c374128825462c1fe380e78de47366e881a264a75a5354395997"} Jun 09 00:03:30.673629 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.673577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.674370 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.674344 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:30.883492 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:30.883459 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:03:31.019092 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:31.019068 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:03:31.020913 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:31.020883 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04be2ea1_ad7d_41c8_83a4_379b99351297.slice/crio-40a3b10a30c91f135a50e26927af5dfc83a176c1c3af28d342d4718f819e8d2d WatchSource:0}: Error finding container 40a3b10a30c91f135a50e26927af5dfc83a176c1c3af28d342d4718f819e8d2d: Status 404 returned error can't find the container with id 40a3b10a30c91f135a50e26927af5dfc83a176c1c3af28d342d4718f819e8d2d Jun 09 00:03:31.466513 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:31.466421 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerStarted","Data":"40a3b10a30c91f135a50e26927af5dfc83a176c1c3af28d342d4718f819e8d2d"} Jun 09 00:03:31.468531 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:31.468492 2562 generic.go:356] "Generic (PLEG): container finished" podID="942cf1e5-5383-4034-a525-7630f3f875c2" containerID="932500f80173c374128825462c1fe380e78de47366e881a264a75a5354395997" exitCode=0 Jun 09 00:03:31.468673 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:31.468567 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m22l8" event={"ID":"942cf1e5-5383-4034-a525-7630f3f875c2","Type":"ContainerDied","Data":"932500f80173c374128825462c1fe380e78de47366e881a264a75a5354395997"} Jun 09 00:03:32.473693 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.473588 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" event={"ID":"9ad5224f-e44d-473d-8034-bc1c7b56f667","Type":"ContainerStarted","Data":"2bebeca20cba6251e10375fc2f719eb60f226f2630f6878fa5170672aec5e1b0"} Jun 09 00:03:32.473693 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.473665 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" event={"ID":"9ad5224f-e44d-473d-8034-bc1c7b56f667","Type":"ContainerStarted","Data":"ec0f35045d65ffae9fe163ac738b6af30db67a48230bb31a43cc2a99c7f5b331"} Jun 09 00:03:32.473693 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.473689 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" event={"ID":"9ad5224f-e44d-473d-8034-bc1c7b56f667","Type":"ContainerStarted","Data":"1c71b9e6b4cf0c135de62523676d23f62cfc9b00ede6ddd0e32132516220245d"} Jun 09 00:03:32.475121 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.475096 2562 generic.go:356] "Generic (PLEG): container finished" podID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerID="10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d" exitCode=0 Jun 09 00:03:32.475226 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.475163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerDied","Data":"10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d"} Jun 09 00:03:32.477269 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.477249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m22l8" event={"ID":"942cf1e5-5383-4034-a525-7630f3f875c2","Type":"ContainerStarted","Data":"2fbde0e75dd5589477ac33abb84d238cf337ab409f801932f3ee4c5d25dcdff1"} Jun 09 00:03:32.477340 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.477297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m22l8" event={"ID":"942cf1e5-5383-4034-a525-7630f3f875c2","Type":"ContainerStarted","Data":"ad2dc3e18849c08c27bbcb896a8d625616f1758cf3a7280bf5492c7620893e3b"} Jun 09 00:03:32.492226 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.492188 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fwhmm" podStartSLOduration=2.749360067 podStartE2EDuration="4.492175941s" totalImagesPullingTime="1.742815874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:32.490949103 +0000 UTC m=+261.313050704" watchObservedRunningTime="2026-06-09 00:03:32.492175941 +0000 UTC m=+261.314277504" Jun 09 00:03:32.528651 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:32.528590 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m22l8" podStartSLOduration=3.357366121 podStartE2EDuration="4.528576407s" totalImagesPullingTime="1.105985545s" totalInitContainerRuntime="65.224741ms" isStatefulPod=true podCreationTimestamp="2026-06-09 00:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:32.5276601 +0000 UTC m=+261.349761664" watchObservedRunningTime="2026-06-09 00:03:32.528576407 +0000 UTC m=+261.350677990" Jun 09 00:03:33.337624 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.337577 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-866cb8fcd5-q6727"] Jun 09 00:03:33.340684 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.340668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.343129 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.343103 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 00:03:33.344366 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.344340 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 00:03:33.344471 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.344346 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 00:03:33.344471 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.344387 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 00:03:33.344550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.344490 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8qnnos073u2oj\"" Jun 09 00:03:33.344635 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.344594 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ph9zz\"" Jun 09 00:03:33.350027 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.349985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-866cb8fcd5-q6727"] Jun 09 00:03:33.497030 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.496998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-client-ca-bundle\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.497431 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.497038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f430493-8227-4496-8a95-3630d72a99c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.497431 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.497063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f430493-8227-4496-8a95-3630d72a99c3-audit-log\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.497431 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.497175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8lv9\" (UniqueName: \"kubernetes.io/projected/4f430493-8227-4496-8a95-3630d72a99c3-kube-api-access-x8lv9\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.497431 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.497211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-secret-metrics-server-client-certs\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.497431 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.497266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f430493-8227-4496-8a95-3630d72a99c3-metrics-server-audit-profiles\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.497431 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.497297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-secret-metrics-server-tls\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.598713 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.598629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-client-ca-bundle\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.598713 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.598701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f430493-8227-4496-8a95-3630d72a99c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.598941 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.598725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f430493-8227-4496-8a95-3630d72a99c3-audit-log\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.598941 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.598824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8lv9\" (UniqueName: \"kubernetes.io/projected/4f430493-8227-4496-8a95-3630d72a99c3-kube-api-access-x8lv9\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.598941 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.598851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-secret-metrics-server-client-certs\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.598941 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.598889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f430493-8227-4496-8a95-3630d72a99c3-metrics-server-audit-profiles\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.598941 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.598923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-secret-metrics-server-tls\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.599173 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.599117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f430493-8227-4496-8a95-3630d72a99c3-audit-log\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.600127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.599512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f430493-8227-4496-8a95-3630d72a99c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.600127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.600060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f430493-8227-4496-8a95-3630d72a99c3-metrics-server-audit-profiles\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.601767 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.601739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-client-ca-bundle\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.602105 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.602078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-secret-metrics-server-tls\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.602707 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.602684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f430493-8227-4496-8a95-3630d72a99c3-secret-metrics-server-client-certs\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.607826 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.607806 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8lv9\" (UniqueName: \"kubernetes.io/projected/4f430493-8227-4496-8a95-3630d72a99c3-kube-api-access-x8lv9\") pod \"metrics-server-866cb8fcd5-q6727\" (UID: \"4f430493-8227-4496-8a95-3630d72a99c3\") " pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.650296 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.650270 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:33.783279 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:33.783247 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-866cb8fcd5-q6727"] Jun 09 00:03:33.786340 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:33.786310 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f430493_8227_4496_8a95_3630d72a99c3.slice/crio-e327e63d74e966287fc35770865356d95b66a078e7017c1c15c7878b8ecf67ad WatchSource:0}: Error finding container e327e63d74e966287fc35770865356d95b66a078e7017c1c15c7878b8ecf67ad: Status 404 returned error can't find the container with id e327e63d74e966287fc35770865356d95b66a078e7017c1c15c7878b8ecf67ad Jun 09 00:03:34.094575 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.094537 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-585c784d69-v78v9"] Jun 09 00:03:34.099101 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.099076 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.101626 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.101585 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 00:03:34.101747 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.101730 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 00:03:34.101747 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.101739 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 00:03:34.101865 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.101739 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l7dft\"" Jun 09 00:03:34.101865 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.101841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 00:03:34.102114 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.102087 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 00:03:34.106939 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.106914 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 00:03:34.110837 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.110807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-585c784d69-v78v9"] Jun 09 00:03:34.203959 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.203921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-metrics-client-ca\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.203959 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.203962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-federate-client-tls\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.204201 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.204002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-secret-telemeter-client\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.204201 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.204035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-serving-certs-ca-bundle\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.204201 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.204078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.204201 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.204124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-telemeter-client-tls\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.204201 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.204153 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.204463 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.204206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rmrf\" (UniqueName: \"kubernetes.io/projected/77ec9814-8270-4687-8dcd-78535081a0bc-kube-api-access-4rmrf\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.305373 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.305333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-serving-certs-ca-bundle\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.305550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.305372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.305550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.305454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-telemeter-client-tls\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.305550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.305482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.305810 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.305638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rmrf\" (UniqueName: \"kubernetes.io/projected/77ec9814-8270-4687-8dcd-78535081a0bc-kube-api-access-4rmrf\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.305810 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.305703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-metrics-client-ca\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.305810 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.305732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-federate-client-tls\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.305960 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.305944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-secret-telemeter-client\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.306328 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.306280 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-serving-certs-ca-bundle\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.306599 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.306574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-metrics-client-ca\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.306844 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.306821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ec9814-8270-4687-8dcd-78535081a0bc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.308232 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.308203 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.308440 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.308421 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-federate-client-tls\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.308518 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.308479 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-secret-telemeter-client\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.308518 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.308506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77ec9814-8270-4687-8dcd-78535081a0bc-telemeter-client-tls\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.312895 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.312874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rmrf\" (UniqueName: \"kubernetes.io/projected/77ec9814-8270-4687-8dcd-78535081a0bc-kube-api-access-4rmrf\") pod \"telemeter-client-585c784d69-v78v9\" (UID: \"77ec9814-8270-4687-8dcd-78535081a0bc\") " pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.412667 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.412636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" Jun 09 00:03:34.489559 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.489528 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerStarted","Data":"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7"} Jun 09 00:03:34.489723 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.489635 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerStarted","Data":"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e"} Jun 09 00:03:34.490880 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.490853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" event={"ID":"4f430493-8227-4496-8a95-3630d72a99c3","Type":"ContainerStarted","Data":"e327e63d74e966287fc35770865356d95b66a078e7017c1c15c7878b8ecf67ad"} Jun 09 00:03:34.568831 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.568802 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-585c784d69-v78v9"] Jun 09 00:03:34.570130 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:34.570104 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ec9814_8270_4687_8dcd_78535081a0bc.slice/crio-64c300f84e20f466b9861152a1241aed1ebf97457a641a69e8e4cf89c50f3cca WatchSource:0}: Error finding container 64c300f84e20f466b9861152a1241aed1ebf97457a641a69e8e4cf89c50f3cca: Status 404 returned error can't find the container with id 64c300f84e20f466b9861152a1241aed1ebf97457a641a69e8e4cf89c50f3cca Jun 09 00:03:34.690544 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.690513 2562 patch_prober.go:28] interesting pod/image-registry-586fd994d5-9xrfl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:03:34.690713 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:34.690566 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" podUID="33459e49-5e73-4216-ae9d-e6d868694063" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:03:35.037091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:35.037019 2562 patch_prober.go:28] interesting pod/image-registry-b8bbc66c7-2sq9n container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:03:35.037091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:35.037084 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:03:35.501683 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:35.501650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerStarted","Data":"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f"} Jun 09 00:03:35.501795 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:35.501736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerStarted","Data":"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7"} Jun 09 00:03:35.501795 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:35.501779 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerStarted","Data":"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb"} Jun 09 00:03:35.502986 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:35.502963 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" event={"ID":"77ec9814-8270-4687-8dcd-78535081a0bc","Type":"ContainerStarted","Data":"64c300f84e20f466b9861152a1241aed1ebf97457a641a69e8e4cf89c50f3cca"} Jun 09 00:03:35.519972 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:35.519922 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" podStartSLOduration=0.874292364 podStartE2EDuration="2.519907857s" totalImagesPullingTime="1.645615493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:35.519656408 +0000 UTC m=+264.341757972" watchObservedRunningTime="2026-06-09 00:03:35.519907857 +0000 UTC m=+264.342009420" Jun 09 00:03:36.407427 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:36.407392 2562 patch_prober.go:28] interesting pod/image-registry-b8bbc66c7-2sq9n container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:03:36.407861 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:36.407452 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:03:36.511600 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:36.511563 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerStarted","Data":"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48"} Jun 09 00:03:36.512964 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:36.512940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" event={"ID":"4f430493-8227-4496-8a95-3630d72a99c3","Type":"ContainerStarted","Data":"2a0498b88e01aecf012c3a40467fe26939afb7a75ab6968ab61dcb66438f26b3"} Jun 09 00:03:36.540623 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:36.540567 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.389560561 podStartE2EDuration="7.540552626s" totalImagesPullingTime="4.133167563s" totalInitContainerRuntime="17.824502ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:36.538292321 +0000 UTC m=+265.360393884" watchObservedRunningTime="2026-06-09 00:03:36.540552626 +0000 UTC m=+265.362654190" Jun 09 00:03:37.518410 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:37.518383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" event={"ID":"77ec9814-8270-4687-8dcd-78535081a0bc","Type":"ContainerStarted","Data":"6e481a091255f3daca7c61fd3a98a7ee241f05a1895ef3673a1afc5b2020282c"} Jun 09 00:03:37.518803 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:37.518437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" event={"ID":"77ec9814-8270-4687-8dcd-78535081a0bc","Type":"ContainerStarted","Data":"c834850fe3837b35f6058583b04b69d6aa917b06a0e95ee756db3b324f5a52fb"} Jun 09 00:03:37.518803 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:37.518455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" event={"ID":"77ec9814-8270-4687-8dcd-78535081a0bc","Type":"ContainerStarted","Data":"dc2c1207ce0e2584d3691c7ea3c689b42ce05cb88529915395b22b85c2c4a69c"} Jun 09 00:03:37.540693 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:37.540298 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-585c784d69-v78v9" podStartSLOduration=0.981807028 podStartE2EDuration="3.540278963s" totalImagesPullingTime="2.558471935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:37.54018618 +0000 UTC m=+266.362287768" watchObservedRunningTime="2026-06-09 00:03:37.540278963 +0000 UTC m=+266.362380527" Jun 09 00:03:39.016882 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.016849 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d7754869-5wg94"] Jun 09 00:03:39.018963 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.018943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.021421 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.021403 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 00:03:39.021510 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.021470 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 00:03:39.022505 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.022481 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 00:03:39.022579 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.022481 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 00:03:39.022579 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.022487 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l4kd4\"" Jun 09 00:03:39.022683 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.022671 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 00:03:39.022806 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.022791 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 00:03:39.023108 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.023088 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 00:03:39.030021 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.030001 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d7754869-5wg94"] Jun 09 00:03:39.155399 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.155370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfstl\" (UniqueName: \"kubernetes.io/projected/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-kube-api-access-qfstl\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.155538 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.155414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-service-ca\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.155538 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.155458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-oauth-config\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.155538 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.155493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-oauth-serving-cert\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.155538 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.155515 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-serving-cert\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.155538 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.155531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-config\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.256316 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.256288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-serving-cert\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.256316 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.256317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-config\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.256477 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.256353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfstl\" (UniqueName: \"kubernetes.io/projected/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-kube-api-access-qfstl\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.256477 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.256379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-service-ca\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.256477 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.256411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-oauth-config\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.256477 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.256445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-oauth-serving-cert\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.257167 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.257146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-config\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.257255 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.257233 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-oauth-serving-cert\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.257356 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.257339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-service-ca\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.258757 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.258737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-oauth-config\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.258848 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.258829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-serving-cert\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.263770 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.263751 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfstl\" (UniqueName: \"kubernetes.io/projected/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-kube-api-access-qfstl\") pod \"console-78d7754869-5wg94\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.328654 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.328586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:39.449429 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.449301 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d7754869-5wg94"] Jun 09 00:03:39.451984 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:39.451957 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84ec2cf_2bb4_44cd_9ef6_9e860c2f95dd.slice/crio-6c0b4a61ce10508f8ae9070503001074cd08e9b9f2461edb45062a046c283214 WatchSource:0}: Error finding container 6c0b4a61ce10508f8ae9070503001074cd08e9b9f2461edb45062a046c283214: Status 404 returned error can't find the container with id 6c0b4a61ce10508f8ae9070503001074cd08e9b9f2461edb45062a046c283214 Jun 09 00:03:39.527039 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.527001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d7754869-5wg94" event={"ID":"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd","Type":"ContainerStarted","Data":"6c0b4a61ce10508f8ae9070503001074cd08e9b9f2461edb45062a046c283214"} Jun 09 00:03:39.703304 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.703201 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" podUID="33459e49-5e73-4216-ae9d-e6d868694063" containerName="registry" containerID="cri-o://941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7" gracePeriod=30 Jun 09 00:03:39.935587 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:39.935565 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:03:40.062849 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.062816 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-image-registry-private-configuration\") pod \"33459e49-5e73-4216-ae9d-e6d868694063\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " Jun 09 00:03:40.062849 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.062850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-installation-pull-secrets\") pod \"33459e49-5e73-4216-ae9d-e6d868694063\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " Jun 09 00:03:40.063354 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.062878 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-trusted-ca\") pod \"33459e49-5e73-4216-ae9d-e6d868694063\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " Jun 09 00:03:40.063354 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.062905 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-bound-sa-token\") pod \"33459e49-5e73-4216-ae9d-e6d868694063\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " Jun 09 00:03:40.063354 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.062933 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") pod \"33459e49-5e73-4216-ae9d-e6d868694063\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " Jun 09 00:03:40.063354 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.063007 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-registry-certificates\") pod \"33459e49-5e73-4216-ae9d-e6d868694063\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " Jun 09 00:03:40.063354 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.063069 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33459e49-5e73-4216-ae9d-e6d868694063-ca-trust-extracted\") pod \"33459e49-5e73-4216-ae9d-e6d868694063\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " Jun 09 00:03:40.063354 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.063108 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzlcf\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-kube-api-access-jzlcf\") pod \"33459e49-5e73-4216-ae9d-e6d868694063\" (UID: \"33459e49-5e73-4216-ae9d-e6d868694063\") " Jun 09 00:03:40.063656 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.063350 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "33459e49-5e73-4216-ae9d-e6d868694063" (UID: "33459e49-5e73-4216-ae9d-e6d868694063"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:03:40.063656 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.063537 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-trusted-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:03:40.063990 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.063969 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "33459e49-5e73-4216-ae9d-e6d868694063" (UID: "33459e49-5e73-4216-ae9d-e6d868694063"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:03:40.065895 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.065865 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "33459e49-5e73-4216-ae9d-e6d868694063" (UID: "33459e49-5e73-4216-ae9d-e6d868694063"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:03:40.065988 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.065887 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "33459e49-5e73-4216-ae9d-e6d868694063" (UID: "33459e49-5e73-4216-ae9d-e6d868694063"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:03:40.065988 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.065895 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-kube-api-access-jzlcf" (OuterVolumeSpecName: "kube-api-access-jzlcf") pod "33459e49-5e73-4216-ae9d-e6d868694063" (UID: "33459e49-5e73-4216-ae9d-e6d868694063"). InnerVolumeSpecName "kube-api-access-jzlcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:03:40.065988 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.065870 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "33459e49-5e73-4216-ae9d-e6d868694063" (UID: "33459e49-5e73-4216-ae9d-e6d868694063"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:03:40.065988 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.065873 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "33459e49-5e73-4216-ae9d-e6d868694063" (UID: "33459e49-5e73-4216-ae9d-e6d868694063"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:03:40.072571 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.072546 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33459e49-5e73-4216-ae9d-e6d868694063-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "33459e49-5e73-4216-ae9d-e6d868694063" (UID: "33459e49-5e73-4216-ae9d-e6d868694063"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:03:40.164373 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.164341 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33459e49-5e73-4216-ae9d-e6d868694063-registry-certificates\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:03:40.164373 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.164369 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33459e49-5e73-4216-ae9d-e6d868694063-ca-trust-extracted\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:03:40.164373 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.164379 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzlcf\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-kube-api-access-jzlcf\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:03:40.164567 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.164388 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-image-registry-private-configuration\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:03:40.164567 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.164398 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33459e49-5e73-4216-ae9d-e6d868694063-installation-pull-secrets\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:03:40.164567 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.164407 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-bound-sa-token\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:03:40.164567 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.164416 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33459e49-5e73-4216-ae9d-e6d868694063-registry-tls\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:03:40.532353 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.532319 2562 generic.go:356] "Generic (PLEG): container finished" podID="33459e49-5e73-4216-ae9d-e6d868694063" containerID="941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7" exitCode=0 Jun 09 00:03:40.532501 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.532365 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" Jun 09 00:03:40.532501 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.532381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" event={"ID":"33459e49-5e73-4216-ae9d-e6d868694063","Type":"ContainerDied","Data":"941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7"} Jun 09 00:03:40.532501 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.532424 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-586fd994d5-9xrfl" event={"ID":"33459e49-5e73-4216-ae9d-e6d868694063","Type":"ContainerDied","Data":"34ce2b8df437ba5b081da7bf4c42e38d3efd80c6b76c934d57b257476058e24a"} Jun 09 00:03:40.532501 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.532445 2562 scope.go:117] "RemoveContainer" containerID="941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7" Jun 09 00:03:40.541534 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.541510 2562 scope.go:117] "RemoveContainer" containerID="941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7" Jun 09 00:03:40.541878 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:40.541860 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7\": container with ID starting with 941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7 not found: ID does not exist" containerID="941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7" Jun 09 00:03:40.541961 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.541883 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7"} err="failed to get container status \"941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7\": rpc error: code = NotFound desc = could not find container \"941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7\": container with ID starting with 941a3f397ef540ff327cd83a40350bb77cd82ceb3ac64921ded5182666879ff7 not found: ID does not exist" Jun 09 00:03:40.552786 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.552762 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-586fd994d5-9xrfl"] Jun 09 00:03:40.556152 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:40.556132 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-586fd994d5-9xrfl"] Jun 09 00:03:41.646469 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:41.643029 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33459e49-5e73-4216-ae9d-e6d868694063" path="/var/lib/kubelet/pods/33459e49-5e73-4216-ae9d-e6d868694063/volumes" Jun 09 00:03:43.548394 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:43.548358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d7754869-5wg94" event={"ID":"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd","Type":"ContainerStarted","Data":"c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a"} Jun 09 00:03:43.565250 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:43.565200 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d7754869-5wg94" podStartSLOduration=0.964788164 podStartE2EDuration="4.565186144s" totalImagesPullingTime="3.60039798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:43.564497609 +0000 UTC m=+272.386599175" watchObservedRunningTime="2026-06-09 00:03:43.565186144 +0000 UTC m=+272.387287706" Jun 09 00:03:45.035025 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:45.034992 2562 patch_prober.go:28] interesting pod/image-registry-b8bbc66c7-2sq9n container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:03:45.035482 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:45.035044 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:03:46.407207 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:46.407160 2562 patch_prober.go:28] interesting pod/image-registry-b8bbc66c7-2sq9n container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:03:46.407567 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:46.407227 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:03:49.329184 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.329143 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:49.329586 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.329228 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:03:49.330491 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.330468 2562 patch_prober.go:28] interesting pod/console-78d7754869-5wg94 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 09 00:03:49.330540 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.330512 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78d7754869-5wg94" podUID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 09 00:03:49.392638 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.392591 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c7f86c77b-4q2wl"] Jun 09 00:03:49.392920 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.392908 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33459e49-5e73-4216-ae9d-e6d868694063" containerName="registry" Jun 09 00:03:49.392961 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.392921 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="33459e49-5e73-4216-ae9d-e6d868694063" containerName="registry" Jun 09 00:03:49.393003 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.392982 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="33459e49-5e73-4216-ae9d-e6d868694063" containerName="registry" Jun 09 00:03:49.398147 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.398124 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.406872 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.406846 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 00:03:49.407232 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.407204 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7f86c77b-4q2wl"] Jun 09 00:03:49.445189 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.445143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-config\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.445361 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.445253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t24g\" (UniqueName: \"kubernetes.io/projected/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-kube-api-access-5t24g\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.445361 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.445290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-trusted-ca-bundle\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.445517 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.445366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-oauth-config\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.445517 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.445397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-service-ca\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.445517 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.445448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-oauth-serving-cert\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.445517 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.445508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-serving-cert\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.546900 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.546861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-trusted-ca-bundle\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547037 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.546922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-oauth-config\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547037 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.546941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-service-ca\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547037 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.546959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-oauth-serving-cert\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547037 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.546981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-serving-cert\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547037 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.547003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-config\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547037 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.547036 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t24g\" (UniqueName: \"kubernetes.io/projected/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-kube-api-access-5t24g\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547848 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.547817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-oauth-serving-cert\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547965 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.547856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-service-ca\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.547965 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.547875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-trusted-ca-bundle\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.548087 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.548000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-config\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.549511 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.549486 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-serving-cert\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.549631 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.549584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-oauth-config\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.554700 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.554679 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t24g\" (UniqueName: \"kubernetes.io/projected/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-kube-api-access-5t24g\") pod \"console-7c7f86c77b-4q2wl\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.708972 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.708881 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:49.835599 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:49.835571 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7f86c77b-4q2wl"] Jun 09 00:03:49.839297 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:49.839268 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e9aa21_1e4d_4197_b6aa_5c71a3aaf546.slice/crio-69971d4901fcbf7c43a515673c8d5d07609271f3e3ad31b1ba4aa408f50abcf6 WatchSource:0}: Error finding container 69971d4901fcbf7c43a515673c8d5d07609271f3e3ad31b1ba4aa408f50abcf6: Status 404 returned error can't find the container with id 69971d4901fcbf7c43a515673c8d5d07609271f3e3ad31b1ba4aa408f50abcf6 Jun 09 00:03:50.576281 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:50.576250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7f86c77b-4q2wl" event={"ID":"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546","Type":"ContainerStarted","Data":"bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720"} Jun 09 00:03:50.576649 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:50.576309 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7f86c77b-4q2wl" event={"ID":"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546","Type":"ContainerStarted","Data":"69971d4901fcbf7c43a515673c8d5d07609271f3e3ad31b1ba4aa408f50abcf6"} Jun 09 00:03:50.592182 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:50.592130 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c7f86c77b-4q2wl" podStartSLOduration=1.592114584 podStartE2EDuration="1.592114584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:50.590951441 +0000 UTC m=+279.413053008" watchObservedRunningTime="2026-06-09 00:03:50.592114584 +0000 UTC m=+279.414216147" Jun 09 00:03:52.160889 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:03:52.160847 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ddnnc" podUID="b40303a4-7e13-473f-9044-3c77f276f2fd" Jun 09 00:03:52.584050 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:52.584015 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ddnnc" Jun 09 00:03:53.650580 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:53.650547 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:53.650984 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:53.650600 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:03:55.035320 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:55.035286 2562 patch_prober.go:28] interesting pod/image-registry-b8bbc66c7-2sq9n container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:03:55.035716 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:55.035336 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:03:55.035716 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:55.035387 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:03:55.035922 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:55.035893 2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"6da40d5063fd39c19edf87694241846dc20d2dec9fe8575a4b5166ea61ede578"} pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 00:03:55.039379 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:55.039355 2562 patch_prober.go:28] interesting pod/image-registry-b8bbc66c7-2sq9n container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:03:55.039496 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:55.039392 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:03:55.903660 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:55.903631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 09 00:03:55.905826 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:55.905799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b40303a4-7e13-473f-9044-3c77f276f2fd-metrics-tls\") pod \"dns-default-ddnnc\" (UID: \"b40303a4-7e13-473f-9044-3c77f276f2fd\") " pod="openshift-dns/dns-default-ddnnc" Jun 09 00:03:56.187484 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:56.187408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw7xv\"" Jun 09 00:03:56.195337 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:56.195310 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ddnnc" Jun 09 00:03:56.344293 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:56.344249 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ddnnc"] Jun 09 00:03:56.346399 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:03:56.346372 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40303a4_7e13_473f_9044_3c77f276f2fd.slice/crio-818b80116c3499b0c80e3a49ac2ad5219f2376380995cb0097239ce94a9a8c5f WatchSource:0}: Error finding container 818b80116c3499b0c80e3a49ac2ad5219f2376380995cb0097239ce94a9a8c5f: Status 404 returned error can't find the container with id 818b80116c3499b0c80e3a49ac2ad5219f2376380995cb0097239ce94a9a8c5f Jun 09 00:03:56.603530 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:56.603494 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ddnnc" event={"ID":"b40303a4-7e13-473f-9044-3c77f276f2fd","Type":"ContainerStarted","Data":"818b80116c3499b0c80e3a49ac2ad5219f2376380995cb0097239ce94a9a8c5f"} Jun 09 00:03:58.613762 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:58.613671 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ddnnc" event={"ID":"b40303a4-7e13-473f-9044-3c77f276f2fd","Type":"ContainerStarted","Data":"601cff3610e712973ee580623d7ea2d146530562efc3e9dbcda0fa9c065f186d"} Jun 09 00:03:58.613762 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:58.613727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ddnnc" event={"ID":"b40303a4-7e13-473f-9044-3c77f276f2fd","Type":"ContainerStarted","Data":"fad7b55f75055e1d9e8bc0be9d50dfac2fd38f82ee432fa41c97c5f0005b02d3"} Jun 09 00:03:58.614142 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:58.613767 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ddnnc" Jun 09 00:03:58.629242 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:58.629187 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ddnnc" podStartSLOduration=250.662451496 podStartE2EDuration="4m12.629170319s" totalImagesPullingTime="1.966718823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:58.628115379 +0000 UTC m=+287.450216942" watchObservedRunningTime="2026-06-09 00:03:58.629170319 +0000 UTC m=+287.451271886" Jun 09 00:03:59.329816 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:59.329781 2562 patch_prober.go:28] interesting pod/console-78d7754869-5wg94 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 09 00:03:59.330005 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:59.329832 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78d7754869-5wg94" podUID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 09 00:03:59.709319 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:59.709239 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:59.709319 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:59.709300 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:03:59.710701 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:59.710682 2562 patch_prober.go:28] interesting pod/console-7c7f86c77b-4q2wl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 00:03:59.710763 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:03:59.710720 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c7f86c77b-4q2wl" podUID="e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 00:04:05.040473 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:05.040431 2562 patch_prober.go:28] interesting pod/image-registry-b8bbc66c7-2sq9n container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:04:05.040961 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:05.040493 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:04:08.621043 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:08.621016 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ddnnc" Jun 09 00:04:09.329035 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:09.328998 2562 patch_prober.go:28] interesting pod/console-78d7754869-5wg94 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 09 00:04:09.329224 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:09.329056 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78d7754869-5wg94" podUID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 09 00:04:09.710086 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:09.709996 2562 patch_prober.go:28] interesting pod/console-7c7f86c77b-4q2wl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 00:04:09.710086 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:09.710066 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c7f86c77b-4q2wl" podUID="e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 00:04:11.395178 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:11.395148 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04be2ea1-ad7d-41c8-83a4-379b99351297/init-config-reloader/0.log" Jun 09 00:04:11.588766 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:11.588733 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 09 00:04:11.590813 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:11.590790 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 09 00:04:11.592221 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:11.592196 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 00:04:11.594276 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:11.594233 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04be2ea1-ad7d-41c8-83a4-379b99351297/alertmanager/0.log" Jun 09 00:04:11.795335 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:11.795290 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04be2ea1-ad7d-41c8-83a4-379b99351297/config-reloader/0.log" Jun 09 00:04:11.994951 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:11.994923 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04be2ea1-ad7d-41c8-83a4-379b99351297/kube-rbac-proxy-web/0.log" Jun 09 00:04:12.197007 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:12.196928 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04be2ea1-ad7d-41c8-83a4-379b99351297/kube-rbac-proxy/0.log" Jun 09 00:04:12.395110 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:12.395071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04be2ea1-ad7d-41c8-83a4-379b99351297/kube-rbac-proxy-metric/0.log" Jun 09 00:04:12.594764 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:12.594731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04be2ea1-ad7d-41c8-83a4-379b99351297/prom-label-proxy/0.log" Jun 09 00:04:12.796317 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:12.796284 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-vcslg_519e81cd-4cb5-4ffb-9f67-c7a919f7393b/cluster-monitoring-operator/0.log" Jun 09 00:04:12.995210 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:12.995170 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fwhmm_9ad5224f-e44d-473d-8034-bc1c7b56f667/kube-state-metrics/0.log" Jun 09 00:04:13.195044 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:13.195013 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fwhmm_9ad5224f-e44d-473d-8034-bc1c7b56f667/kube-rbac-proxy-main/0.log" Jun 09 00:04:13.395293 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:13.395212 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fwhmm_9ad5224f-e44d-473d-8034-bc1c7b56f667/kube-rbac-proxy-self/0.log" Jun 09 00:04:13.598588 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:13.598554 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-866cb8fcd5-q6727_4f430493-8227-4496-8a95-3630d72a99c3/metrics-server/0.log" Jun 09 00:04:13.655879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:13.655806 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:04:13.659794 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:13.659766 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-866cb8fcd5-q6727" Jun 09 00:04:13.994201 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:13.994168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m22l8_942cf1e5-5383-4034-a525-7630f3f875c2/init-textfile/0.log" Jun 09 00:04:14.196181 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:14.196153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m22l8_942cf1e5-5383-4034-a525-7630f3f875c2/node-exporter/0.log" Jun 09 00:04:14.394049 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:14.393977 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m22l8_942cf1e5-5383-4034-a525-7630f3f875c2/kube-rbac-proxy/0.log" Jun 09 00:04:15.039840 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:15.039806 2562 patch_prober.go:28] interesting pod/image-registry-b8bbc66c7-2sq9n container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 00:04:15.040222 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:15.039856 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:04:18.394438 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:18.394403 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c784d69-v78v9_77ec9814-8270-4687-8dcd-78535081a0bc/telemeter-client/0.log" Jun 09 00:04:18.597791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:18.597752 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c784d69-v78v9_77ec9814-8270-4687-8dcd-78535081a0bc/reload/0.log" Jun 09 00:04:18.795096 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:18.795067 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c784d69-v78v9_77ec9814-8270-4687-8dcd-78535081a0bc/kube-rbac-proxy/0.log" Jun 09 00:04:19.333584 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:19.333557 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:04:19.337264 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:19.337243 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:04:19.713780 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:19.713685 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:04:19.717808 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:19.717781 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:04:19.803800 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:19.803758 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d7754869-5wg94"] Jun 09 00:04:20.054826 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:20.054778 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" podUID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerName="registry" containerID="cri-o://6da40d5063fd39c19edf87694241846dc20d2dec9fe8575a4b5166ea61ede578" gracePeriod=30 Jun 09 00:04:20.194871 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:20.194832 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-2qz5n_57a995c9-bcac-4085-9d93-4dcb7d2e5249/networking-console-plugin/0.log" Jun 09 00:04:20.795081 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:20.795051 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78d7754869-5wg94_d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd/console/0.log" Jun 09 00:04:20.995468 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:20.995441 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c7f86c77b-4q2wl_e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546/console/0.log" Jun 09 00:04:21.708083 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:21.708052 2562 generic.go:356] "Generic (PLEG): container finished" podID="62f4d32e-c86f-440f-a035-eeec5c4f50da" containerID="6da40d5063fd39c19edf87694241846dc20d2dec9fe8575a4b5166ea61ede578" exitCode=0 Jun 09 00:04:21.708239 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:21.708099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" event={"ID":"62f4d32e-c86f-440f-a035-eeec5c4f50da","Type":"ContainerDied","Data":"6da40d5063fd39c19edf87694241846dc20d2dec9fe8575a4b5166ea61ede578"} Jun 09 00:04:21.708239 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:21.708155 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" event={"ID":"62f4d32e-c86f-440f-a035-eeec5c4f50da","Type":"ContainerStarted","Data":"11dfd47033f09ec7b743093bfbe7c0f7e2eca6a8a8b5889a1c391dc6a50f1846"} Jun 09 00:04:21.708322 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:21.708308 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:04:22.198177 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:22.198150 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ddnnc_b40303a4-7e13-473f-9044-3c77f276f2fd/dns/0.log" Jun 09 00:04:22.395004 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:22.394972 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ddnnc_b40303a4-7e13-473f-9044-3c77f276f2fd/kube-rbac-proxy/0.log" Jun 09 00:04:22.794412 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:22.794384 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whcbr_f43a7ef4-2b19-4359-880d-e0a37348fe36/dns-node-resolver/0.log" Jun 09 00:04:23.195957 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:23.195879 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29682720-p5shc_552b6253-8d86-4fcf-a2d6-3e77dcea0700/image-pruner/0.log" Jun 09 00:04:23.595391 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:23.595363 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b8bbc66c7-2sq9n_62f4d32e-c86f-440f-a035-eeec5c4f50da/registry/1.log" Jun 09 00:04:23.995185 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:23.995152 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8zk8_9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4/node-ca/0.log" Jun 09 00:04:24.594843 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:24.594818 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6dk5_01aec00e-ba0c-4439-af7d-cfd67a3cf234/serve-healthcheck-canary/0.log" Jun 09 00:04:42.716859 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:42.716830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b8bbc66c7-2sq9n" Jun 09 00:04:45.723003 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:45.722940 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78d7754869-5wg94" podUID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" containerName="console" containerID="cri-o://c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a" gracePeriod=15 Jun 09 00:04:45.979300 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:45.979249 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:04:46.026338 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026313 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-oauth-config\") pod \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " Jun 09 00:04:46.026472 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026365 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-config\") pod \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " Jun 09 00:04:46.026472 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026387 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfstl\" (UniqueName: \"kubernetes.io/projected/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-kube-api-access-qfstl\") pod \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " Jun 09 00:04:46.026472 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026407 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-serving-cert\") pod \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " Jun 09 00:04:46.026472 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026458 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-oauth-serving-cert\") pod \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " Jun 09 00:04:46.026652 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026485 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-service-ca\") pod \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\" (UID: \"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd\") " Jun 09 00:04:46.026917 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026886 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" (UID: "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:46.026917 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026886 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" (UID: "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:46.027096 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.026942 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-config" (OuterVolumeSpecName: "console-config") pod "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" (UID: "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:46.028772 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.028739 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" (UID: "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:46.028875 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.028796 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-kube-api-access-qfstl" (OuterVolumeSpecName: "kube-api-access-qfstl") pod "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" (UID: "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd"). InnerVolumeSpecName "kube-api-access-qfstl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:04:46.028875 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.028819 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" (UID: "d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:46.127520 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.127477 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-oauth-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:46.127520 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.127514 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:46.127520 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.127524 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfstl\" (UniqueName: \"kubernetes.io/projected/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-kube-api-access-qfstl\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:46.127520 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.127533 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-console-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:46.127787 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.127542 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-oauth-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:46.127787 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.127550 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd-service-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:46.811665 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.811631 2562 generic.go:356] "Generic (PLEG): container finished" podID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" containerID="c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a" exitCode=0 Jun 09 00:04:46.812053 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.811680 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d7754869-5wg94" Jun 09 00:04:46.812053 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.811699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d7754869-5wg94" event={"ID":"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd","Type":"ContainerDied","Data":"c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a"} Jun 09 00:04:46.812053 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.811736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d7754869-5wg94" event={"ID":"d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd","Type":"ContainerDied","Data":"6c0b4a61ce10508f8ae9070503001074cd08e9b9f2461edb45062a046c283214"} Jun 09 00:04:46.812053 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.811755 2562 scope.go:117] "RemoveContainer" containerID="c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a" Jun 09 00:04:46.819955 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.819934 2562 scope.go:117] "RemoveContainer" containerID="c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a" Jun 09 00:04:46.820197 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:04:46.820177 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a\": container with ID starting with c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a not found: ID does not exist" containerID="c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a" Jun 09 00:04:46.820254 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.820204 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a"} err="failed to get container status \"c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a\": rpc error: code = NotFound desc = could not find container \"c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a\": container with ID starting with c1bd9a9c14d0262df0a5d1113373746a2e7c07427ed7916c7f51c91e00dd469a not found: ID does not exist" Jun 09 00:04:46.832010 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.831990 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d7754869-5wg94"] Jun 09 00:04:46.835524 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:46.835504 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d7754869-5wg94"] Jun 09 00:04:47.643086 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.643056 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" path="/var/lib/kubelet/pods/d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd/volumes" Jun 09 00:04:47.855452 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.855418 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd6c94469-c5mbx"] Jun 09 00:04:47.855857 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.855744 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" containerName="console" Jun 09 00:04:47.855857 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.855761 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" containerName="console" Jun 09 00:04:47.855857 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.855826 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d84ec2cf-2bb4-44cd-9ef6-9e860c2f95dd" containerName="console" Jun 09 00:04:47.860746 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.860728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:47.869515 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.869488 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd6c94469-c5mbx"] Jun 09 00:04:47.941184 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.941125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-console-config\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:47.941288 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.941233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-serving-cert\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:47.941288 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.941259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-service-ca\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:47.941360 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.941312 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-oauth-serving-cert\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:47.941360 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.941338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt6dd\" (UniqueName: \"kubernetes.io/projected/5b12611c-4222-4f5f-ae20-58644e7f5207-kube-api-access-xt6dd\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:47.941360 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.941356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-oauth-config\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:47.941452 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:47.941372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-trusted-ca-bundle\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.042301 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.042271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-serving-cert\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.042423 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.042301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-service-ca\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.042423 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.042343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-oauth-serving-cert\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.042423 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.042370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt6dd\" (UniqueName: \"kubernetes.io/projected/5b12611c-4222-4f5f-ae20-58644e7f5207-kube-api-access-xt6dd\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.042423 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.042393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-oauth-config\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.042423 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.042416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-trusted-ca-bundle\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.042691 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.042442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-console-config\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.043203 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.043168 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-console-config\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.043313 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.043168 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-service-ca\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.043313 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.043264 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-oauth-serving-cert\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.043430 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.043320 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-trusted-ca-bundle\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.044797 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.044770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-oauth-config\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.044973 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.044941 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-serving-cert\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.050226 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.050200 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt6dd\" (UniqueName: \"kubernetes.io/projected/5b12611c-4222-4f5f-ae20-58644e7f5207-kube-api-access-xt6dd\") pod \"console-dd6c94469-c5mbx\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.170822 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.170801 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:48.294939 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.294910 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd6c94469-c5mbx"] Jun 09 00:04:48.297419 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:04:48.297394 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b12611c_4222_4f5f_ae20_58644e7f5207.slice/crio-863d49eaa4a377b0f6ee0af5e4e0111f6d06d410b4d44a820a3fe89a4e333f82 WatchSource:0}: Error finding container 863d49eaa4a377b0f6ee0af5e4e0111f6d06d410b4d44a820a3fe89a4e333f82: Status 404 returned error can't find the container with id 863d49eaa4a377b0f6ee0af5e4e0111f6d06d410b4d44a820a3fe89a4e333f82 Jun 09 00:04:48.823581 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.823553 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd6c94469-c5mbx" event={"ID":"5b12611c-4222-4f5f-ae20-58644e7f5207","Type":"ContainerStarted","Data":"51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0"} Jun 09 00:04:48.823813 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.823602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd6c94469-c5mbx" event={"ID":"5b12611c-4222-4f5f-ae20-58644e7f5207","Type":"ContainerStarted","Data":"863d49eaa4a377b0f6ee0af5e4e0111f6d06d410b4d44a820a3fe89a4e333f82"} Jun 09 00:04:48.842403 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:48.842360 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd6c94469-c5mbx" podStartSLOduration=1.8423451800000001 podStartE2EDuration="1.84234518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:04:48.840624125 +0000 UTC m=+337.662725686" watchObservedRunningTime="2026-06-09 00:04:48.84234518 +0000 UTC m=+337.664446742" Jun 09 00:04:49.216778 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.216700 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:04:49.217136 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.216992 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="alertmanager" containerID="cri-o://64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e" gracePeriod=120 Jun 09 00:04:49.217136 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.217043 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy-metric" containerID="cri-o://7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f" gracePeriod=120 Jun 09 00:04:49.217136 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.217082 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="config-reloader" containerID="cri-o://2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7" gracePeriod=120 Jun 09 00:04:49.217136 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.217078 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy-web" containerID="cri-o://f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb" gracePeriod=120 Jun 09 00:04:49.217136 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.217115 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="prom-label-proxy" containerID="cri-o://7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48" gracePeriod=120 Jun 09 00:04:49.217392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.217090 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy" containerID="cri-o://54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7" gracePeriod=120 Jun 09 00:04:49.831109 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.831078 2562 generic.go:356] "Generic (PLEG): container finished" podID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerID="7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48" exitCode=0 Jun 09 00:04:49.831109 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.831102 2562 generic.go:356] "Generic (PLEG): container finished" podID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerID="54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7" exitCode=0 Jun 09 00:04:49.831109 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.831109 2562 generic.go:356] "Generic (PLEG): container finished" podID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerID="2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7" exitCode=0 Jun 09 00:04:49.831109 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.831115 2562 generic.go:356] "Generic (PLEG): container finished" podID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerID="64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e" exitCode=0 Jun 09 00:04:49.831379 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.831146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerDied","Data":"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48"} Jun 09 00:04:49.831379 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.831216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerDied","Data":"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7"} Jun 09 00:04:49.831379 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.831243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerDied","Data":"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7"} Jun 09 00:04:49.831379 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:49.831267 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerDied","Data":"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e"} Jun 09 00:04:50.465123 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.465096 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.563442 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563358 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-main-db\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563442 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563398 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563442 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563421 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-config-volume\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563442 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563440 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-main-tls\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563769 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563567 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-cluster-tls-config\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563769 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563620 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-config-out\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563769 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563644 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-tls-assets\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563769 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563680 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-web\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563769 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563708 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.563769 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563746 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-web-config\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.564098 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563776 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-metric\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.564098 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563800 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:04:50.564098 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563821 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lhlw\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-kube-api-access-5lhlw\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.564098 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.563875 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-metrics-client-ca\") pod \"04be2ea1-ad7d-41c8-83a4-379b99351297\" (UID: \"04be2ea1-ad7d-41c8-83a4-379b99351297\") " Jun 09 00:04:50.564334 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.564181 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-main-db\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.564798 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.564516 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:50.566560 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.566422 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:04:50.566560 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.566519 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:04:50.566843 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.566809 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:50.566922 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.566870 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-config-out" (OuterVolumeSpecName: "config-out") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:04:50.567028 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.567004 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-config-volume" (OuterVolumeSpecName: "config-volume") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:50.567538 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.567518 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:50.567857 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.567834 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:50.568579 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.568557 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-kube-api-access-5lhlw" (OuterVolumeSpecName: "kube-api-access-5lhlw") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "kube-api-access-5lhlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:04:50.568664 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.568549 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:50.571766 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.571627 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:50.578667 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.578646 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-web-config" (OuterVolumeSpecName: "web-config") pod "04be2ea1-ad7d-41c8-83a4-379b99351297" (UID: "04be2ea1-ad7d-41c8-83a4-379b99351297"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:04:50.664983 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.664943 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-cluster-tls-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.664983 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.664974 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04be2ea1-ad7d-41c8-83a4-379b99351297-config-out\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.664983 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.664987 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-tls-assets\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.664999 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.665012 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.665024 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-web-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.665036 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.665048 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lhlw\" (UniqueName: \"kubernetes.io/projected/04be2ea1-ad7d-41c8-83a4-379b99351297-kube-api-access-5lhlw\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.665060 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04be2ea1-ad7d-41c8-83a4-379b99351297-metrics-client-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.665072 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.665083 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-config-volume\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.665230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.665093 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04be2ea1-ad7d-41c8-83a4-379b99351297-secret-alertmanager-main-tls\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:04:50.838710 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.838600 2562 generic.go:356] "Generic (PLEG): container finished" podID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerID="7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f" exitCode=0 Jun 09 00:04:50.838710 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.838643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerDied","Data":"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f"} Jun 09 00:04:50.838710 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.838699 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.838710 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.838712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerDied","Data":"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb"} Jun 09 00:04:50.839003 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.838655 2562 generic.go:356] "Generic (PLEG): container finished" podID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerID="f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb" exitCode=0 Jun 09 00:04:50.839003 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.838745 2562 scope.go:117] "RemoveContainer" containerID="7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48" Jun 09 00:04:50.839003 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.838805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04be2ea1-ad7d-41c8-83a4-379b99351297","Type":"ContainerDied","Data":"40a3b10a30c91f135a50e26927af5dfc83a176c1c3af28d342d4718f819e8d2d"} Jun 09 00:04:50.847300 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.847288 2562 scope.go:117] "RemoveContainer" containerID="7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f" Jun 09 00:04:50.854034 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.854012 2562 scope.go:117] "RemoveContainer" containerID="54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7" Jun 09 00:04:50.860966 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.860875 2562 scope.go:117] "RemoveContainer" containerID="f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb" Jun 09 00:04:50.863309 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.863289 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:04:50.867026 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.867004 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:04:50.868209 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.868196 2562 scope.go:117] "RemoveContainer" containerID="2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7" Jun 09 00:04:50.874849 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.874832 2562 scope.go:117] "RemoveContainer" containerID="64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e" Jun 09 00:04:50.881717 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.881544 2562 scope.go:117] "RemoveContainer" containerID="10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d" Jun 09 00:04:50.888414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.888399 2562 scope.go:117] "RemoveContainer" containerID="7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48" Jun 09 00:04:50.888697 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:04:50.888679 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48\": container with ID starting with 7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48 not found: ID does not exist" containerID="7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48" Jun 09 00:04:50.888869 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.888708 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48"} err="failed to get container status \"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48\": rpc error: code = NotFound desc = could not find container \"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48\": container with ID starting with 7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48 not found: ID does not exist" Jun 09 00:04:50.888869 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.888724 2562 scope.go:117] "RemoveContainer" containerID="7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f" Jun 09 00:04:50.889069 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:04:50.889044 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f\": container with ID starting with 7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f not found: ID does not exist" containerID="7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f" Jun 09 00:04:50.889147 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.889078 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f"} err="failed to get container status \"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f\": rpc error: code = NotFound desc = could not find container \"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f\": container with ID starting with 7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f not found: ID does not exist" Jun 09 00:04:50.889147 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.889100 2562 scope.go:117] "RemoveContainer" containerID="54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7" Jun 09 00:04:50.889393 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:04:50.889353 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7\": container with ID starting with 54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7 not found: ID does not exist" containerID="54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7" Jun 09 00:04:50.889469 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.889384 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7"} err="failed to get container status \"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7\": rpc error: code = NotFound desc = could not find container \"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7\": container with ID starting with 54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7 not found: ID does not exist" Jun 09 00:04:50.889469 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.889404 2562 scope.go:117] "RemoveContainer" containerID="f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb" Jun 09 00:04:50.889699 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:04:50.889680 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb\": container with ID starting with f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb not found: ID does not exist" containerID="f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb" Jun 09 00:04:50.889784 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.889712 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb"} err="failed to get container status \"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb\": rpc error: code = NotFound desc = could not find container \"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb\": container with ID starting with f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb not found: ID does not exist" Jun 09 00:04:50.889784 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.889731 2562 scope.go:117] "RemoveContainer" containerID="2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7" Jun 09 00:04:50.890002 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:04:50.889975 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7\": container with ID starting with 2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7 not found: ID does not exist" containerID="2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7" Jun 09 00:04:50.890081 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.890008 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7"} err="failed to get container status \"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7\": rpc error: code = NotFound desc = could not find container \"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7\": container with ID starting with 2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7 not found: ID does not exist" Jun 09 00:04:50.890081 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.890048 2562 scope.go:117] "RemoveContainer" containerID="64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e" Jun 09 00:04:50.890354 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:04:50.890338 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e\": container with ID starting with 64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e not found: ID does not exist" containerID="64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e" Jun 09 00:04:50.890393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.890357 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e"} err="failed to get container status \"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e\": rpc error: code = NotFound desc = could not find container \"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e\": container with ID starting with 64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e not found: ID does not exist" Jun 09 00:04:50.890393 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.890371 2562 scope.go:117] "RemoveContainer" containerID="10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d" Jun 09 00:04:50.890601 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:04:50.890581 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d\": container with ID starting with 10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d not found: ID does not exist" containerID="10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d" Jun 09 00:04:50.890675 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.890623 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d"} err="failed to get container status \"10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d\": rpc error: code = NotFound desc = could not find container \"10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d\": container with ID starting with 10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d not found: ID does not exist" Jun 09 00:04:50.890675 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.890637 2562 scope.go:117] "RemoveContainer" containerID="7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48" Jun 09 00:04:50.890843 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.890822 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48"} err="failed to get container status \"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48\": rpc error: code = NotFound desc = could not find container \"7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48\": container with ID starting with 7ca2e2630cc3a55e430a1a4a132d16716268d6d87a1dbd6644760ac8de933f48 not found: ID does not exist" Jun 09 00:04:50.890903 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.890846 2562 scope.go:117] "RemoveContainer" containerID="7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f" Jun 09 00:04:50.891056 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891038 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:04:50.891099 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891051 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f"} err="failed to get container status \"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f\": rpc error: code = NotFound desc = could not find container \"7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f\": container with ID starting with 7a978725307cf531356f2177e233569876ddf0794cfddcfdd3955de49b417e9f not found: ID does not exist" Jun 09 00:04:50.891099 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891066 2562 scope.go:117] "RemoveContainer" containerID="54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7" Jun 09 00:04:50.891266 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891250 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7"} err="failed to get container status \"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7\": rpc error: code = NotFound desc = could not find container \"54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7\": container with ID starting with 54ff4b957ca11338829e56677371bb8fdbbcdb497547bc34938dad6748196ae7 not found: ID does not exist" Jun 09 00:04:50.891311 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891266 2562 scope.go:117] "RemoveContainer" containerID="f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb" Jun 09 00:04:50.891381 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891366 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="config-reloader" Jun 09 00:04:50.891424 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891385 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="config-reloader" Jun 09 00:04:50.891424 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891398 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy-web" Jun 09 00:04:50.891424 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891407 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy-web" Jun 09 00:04:50.891424 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891418 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="init-config-reloader" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891427 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="init-config-reloader" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891439 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="alertmanager" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891448 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="alertmanager" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891464 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy-metric" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891472 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy-metric" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891483 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="prom-label-proxy" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891483 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb"} err="failed to get container status \"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb\": rpc error: code = NotFound desc = could not find container \"f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb\": container with ID starting with f125adc44b63e1cb8f59b4ea4583890efea721aaf0d24a5d675870d40855dedb not found: ID does not exist" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891512 2562 scope.go:117] "RemoveContainer" containerID="2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7" Jun 09 00:04:50.891550 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891492 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="prom-label-proxy" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891558 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891566 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891680 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy-metric" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891695 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="prom-label-proxy" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891704 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="config-reloader" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891715 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy-web" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891723 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="kube-rbac-proxy" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891732 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" containerName="alertmanager" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891846 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7"} err="failed to get container status \"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7\": rpc error: code = NotFound desc = could not find container \"2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7\": container with ID starting with 2fe5d77384db94ea0616a8fe6f7e71277b17f1eb216317351282dee895242ba7 not found: ID does not exist" Jun 09 00:04:50.891879 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.891866 2562 scope.go:117] "RemoveContainer" containerID="64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e" Jun 09 00:04:50.892295 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.892122 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e"} err="failed to get container status \"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e\": rpc error: code = NotFound desc = could not find container \"64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e\": container with ID starting with 64dc145d2232c2eb612357850d9527a736b936f29379cbde5df567370d577e9e not found: ID does not exist" Jun 09 00:04:50.892295 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.892139 2562 scope.go:117] "RemoveContainer" containerID="10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d" Jun 09 00:04:50.892409 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.892383 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d"} err="failed to get container status \"10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d\": rpc error: code = NotFound desc = could not find container \"10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d\": container with ID starting with 10c739cbda4d6213c252cce9b0afbe0717cefe4779486235d8c9736ca495d75d not found: ID does not exist" Jun 09 00:04:50.896876 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.896861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.900905 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.900884 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 00:04:50.901023 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.900884 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 00:04:50.901178 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.901148 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 00:04:50.901261 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.901237 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 00:04:50.901375 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.901356 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vqr42\"" Jun 09 00:04:50.901483 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.901425 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 00:04:50.901483 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.901365 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 00:04:50.901624 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.901503 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 00:04:50.901624 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.901595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 00:04:50.907317 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.907297 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 00:04:50.908241 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.908220 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:04:50.967125 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8275527d-cd3e-451a-9881-8c394c87fa0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967125 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm9ns\" (UniqueName: \"kubernetes.io/projected/8275527d-cd3e-451a-9881-8c394c87fa0b-kube-api-access-xm9ns\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967351 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8275527d-cd3e-451a-9881-8c394c87fa0b-config-out\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967351 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967351 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967351 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8275527d-cd3e-451a-9881-8c394c87fa0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967351 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8275527d-cd3e-451a-9881-8c394c87fa0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967667 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-web-config\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967667 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967667 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967667 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8275527d-cd3e-451a-9881-8c394c87fa0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967667 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:50.967667 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:50.967533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068444 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068444 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8275527d-cd3e-451a-9881-8c394c87fa0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068444 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm9ns\" (UniqueName: \"kubernetes.io/projected/8275527d-cd3e-451a-9881-8c394c87fa0b-kube-api-access-xm9ns\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068714 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8275527d-cd3e-451a-9881-8c394c87fa0b-config-out\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068714 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068714 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068714 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8275527d-cd3e-451a-9881-8c394c87fa0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068714 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8275527d-cd3e-451a-9881-8c394c87fa0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068931 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-web-config\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.068994 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.069052 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.068984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8275527d-cd3e-451a-9881-8c394c87fa0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.069052 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.069012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.069280 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.069255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8275527d-cd3e-451a-9881-8c394c87fa0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.069450 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.069427 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8275527d-cd3e-451a-9881-8c394c87fa0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.069646 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.069627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8275527d-cd3e-451a-9881-8c394c87fa0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.069781 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.069762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.071676 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.071650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.071770 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.071682 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.071770 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.071718 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-web-config\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.071770 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.071760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.071953 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.071784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8275527d-cd3e-451a-9881-8c394c87fa0b-config-out\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.072006 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.071979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.072060 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.072001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.072407 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.072387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8275527d-cd3e-451a-9881-8c394c87fa0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.073443 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.073427 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8275527d-cd3e-451a-9881-8c394c87fa0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.076007 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.075985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm9ns\" (UniqueName: \"kubernetes.io/projected/8275527d-cd3e-451a-9881-8c394c87fa0b-kube-api-access-xm9ns\") pod \"alertmanager-main-0\" (UID: \"8275527d-cd3e-451a-9881-8c394c87fa0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.205780 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.205700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:04:51.358830 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.358805 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:04:51.360950 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:04:51.360920 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8275527d_cd3e_451a_9881_8c394c87fa0b.slice/crio-a15834254790f1c34ece1b5d89bca2aeb69680f1805c118501741b9cc711fa57 WatchSource:0}: Error finding container a15834254790f1c34ece1b5d89bca2aeb69680f1805c118501741b9cc711fa57: Status 404 returned error can't find the container with id a15834254790f1c34ece1b5d89bca2aeb69680f1805c118501741b9cc711fa57 Jun 09 00:04:51.647940 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.647905 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04be2ea1-ad7d-41c8-83a4-379b99351297" path="/var/lib/kubelet/pods/04be2ea1-ad7d-41c8-83a4-379b99351297/volumes" Jun 09 00:04:51.845822 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.845788 2562 generic.go:356] "Generic (PLEG): container finished" podID="8275527d-cd3e-451a-9881-8c394c87fa0b" containerID="82c7c1221ec6f74b1c0644ab35cbd5b2493355242cb47c56d5a45f238e578aba" exitCode=0 Jun 09 00:04:51.845971 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.845874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8275527d-cd3e-451a-9881-8c394c87fa0b","Type":"ContainerDied","Data":"82c7c1221ec6f74b1c0644ab35cbd5b2493355242cb47c56d5a45f238e578aba"} Jun 09 00:04:51.845971 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:51.845932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8275527d-cd3e-451a-9881-8c394c87fa0b","Type":"ContainerStarted","Data":"a15834254790f1c34ece1b5d89bca2aeb69680f1805c118501741b9cc711fa57"} Jun 09 00:04:52.853472 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:52.853434 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8275527d-cd3e-451a-9881-8c394c87fa0b","Type":"ContainerStarted","Data":"77ecbf22a3ca58acfc37b115f9b4b3807c50f31f2883debbc3a92a4168e03f0d"} Jun 09 00:04:52.853845 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:52.853513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8275527d-cd3e-451a-9881-8c394c87fa0b","Type":"ContainerStarted","Data":"4c6cbe301ed86dc7fb65d77bcf5383b7715f7ecdad59169fea3d7e9f4eeba3f3"} Jun 09 00:04:52.853845 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:52.853572 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8275527d-cd3e-451a-9881-8c394c87fa0b","Type":"ContainerStarted","Data":"3b98d7dba8c774d7945feee39707f2dfb41e0f65a06cc432777337411fc5fd85"} Jun 09 00:04:52.853845 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:52.853633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8275527d-cd3e-451a-9881-8c394c87fa0b","Type":"ContainerStarted","Data":"9724056c4447b03a78cb24a8d095fe8d799d1c33ea724548b80db2a5d7bd37ff"} Jun 09 00:04:52.853845 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:52.853673 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8275527d-cd3e-451a-9881-8c394c87fa0b","Type":"ContainerStarted","Data":"14af274eaa687b903ccd07e29ff87151cf3cd8b1a76f67676ae87dda8dddb658"} Jun 09 00:04:52.853845 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:52.853709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8275527d-cd3e-451a-9881-8c394c87fa0b","Type":"ContainerStarted","Data":"3336655a52210a5a24b23c131cf6ab6a63a90280ba56c17050e685171e605bf5"} Jun 09 00:04:52.879195 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:52.879119 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.865221328 podStartE2EDuration="2.879099301s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.877973ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:04:52.877158027 +0000 UTC m=+341.699259587" watchObservedRunningTime="2026-06-09 00:04:52.879099301 +0000 UTC m=+341.701200864" Jun 09 00:04:58.171657 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:58.171538 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:58.171657 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:58.171601 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:58.176347 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:58.176321 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:58.881178 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:58.881142 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:04:58.927134 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:04:58.927101 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7f86c77b-4q2wl"] Jun 09 00:05:01.892973 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:01.892941 2562 generic.go:356] "Generic (PLEG): container finished" podID="552b6253-8d86-4fcf-a2d6-3e77dcea0700" containerID="aadc2a1ec8330b00247805e64b2a7e97cd524c0f570930ff382fa47ce13bdf68" exitCode=0 Jun 09 00:05:01.893360 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:01.893019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29682720-p5shc" event={"ID":"552b6253-8d86-4fcf-a2d6-3e77dcea0700","Type":"ContainerDied","Data":"aadc2a1ec8330b00247805e64b2a7e97cd524c0f570930ff382fa47ce13bdf68"} Jun 09 00:05:03.027268 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.027241 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:05:03.178171 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.178079 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/552b6253-8d86-4fcf-a2d6-3e77dcea0700-serviceca\") pod \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\" (UID: \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\") " Jun 09 00:05:03.178171 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.178148 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89k99\" (UniqueName: \"kubernetes.io/projected/552b6253-8d86-4fcf-a2d6-3e77dcea0700-kube-api-access-89k99\") pod \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\" (UID: \"552b6253-8d86-4fcf-a2d6-3e77dcea0700\") " Jun 09 00:05:03.178489 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.178466 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552b6253-8d86-4fcf-a2d6-3e77dcea0700-serviceca" (OuterVolumeSpecName: "serviceca") pod "552b6253-8d86-4fcf-a2d6-3e77dcea0700" (UID: "552b6253-8d86-4fcf-a2d6-3e77dcea0700"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:05:03.180279 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.180257 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552b6253-8d86-4fcf-a2d6-3e77dcea0700-kube-api-access-89k99" (OuterVolumeSpecName: "kube-api-access-89k99") pod "552b6253-8d86-4fcf-a2d6-3e77dcea0700" (UID: "552b6253-8d86-4fcf-a2d6-3e77dcea0700"). InnerVolumeSpecName "kube-api-access-89k99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:05:03.279600 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.279544 2562 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/552b6253-8d86-4fcf-a2d6-3e77dcea0700-serviceca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:03.279600 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.279590 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89k99\" (UniqueName: \"kubernetes.io/projected/552b6253-8d86-4fcf-a2d6-3e77dcea0700-kube-api-access-89k99\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:03.902442 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.902360 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29682720-p5shc" event={"ID":"552b6253-8d86-4fcf-a2d6-3e77dcea0700","Type":"ContainerDied","Data":"4431fff83ea89db305484fe76c3585c9fb68d858ab01554c3f2eb6a0edceae47"} Jun 09 00:05:03.902442 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.902406 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4431fff83ea89db305484fe76c3585c9fb68d858ab01554c3f2eb6a0edceae47" Jun 09 00:05:03.902442 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:03.902375 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29682720-p5shc" Jun 09 00:05:23.955417 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:23.955354 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c7f86c77b-4q2wl" podUID="e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" containerName="console" containerID="cri-o://bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720" gracePeriod=15 Jun 09 00:05:24.204458 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.204433 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:05:24.247562 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.247540 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-service-ca\") pod \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " Jun 09 00:05:24.247705 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.247569 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-oauth-serving-cert\") pod \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " Jun 09 00:05:24.247705 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.247592 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-serving-cert\") pod \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " Jun 09 00:05:24.247705 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.247637 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t24g\" (UniqueName: \"kubernetes.io/projected/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-kube-api-access-5t24g\") pod \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " Jun 09 00:05:24.247705 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.247684 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-trusted-ca-bundle\") pod \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " Jun 09 00:05:24.247892 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.247713 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-config\") pod \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " Jun 09 00:05:24.247892 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.247773 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-oauth-config\") pod \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\" (UID: \"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546\") " Jun 09 00:05:24.248090 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.247944 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" (UID: "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:05:24.248202 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.248099 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" (UID: "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:05:24.248202 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.248122 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-config" (OuterVolumeSpecName: "console-config") pod "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" (UID: "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:05:24.248202 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.248172 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" (UID: "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:05:24.249878 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.249853 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" (UID: "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:05:24.249978 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.249905 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-kube-api-access-5t24g" (OuterVolumeSpecName: "kube-api-access-5t24g") pod "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" (UID: "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546"). InnerVolumeSpecName "kube-api-access-5t24g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:05:24.249978 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.249906 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" (UID: "e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:05:24.348317 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.348292 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-trusted-ca-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:24.348317 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.348314 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:24.348317 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.348322 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-oauth-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:24.348502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.348331 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-service-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:24.348502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.348341 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-oauth-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:24.348502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.348349 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-console-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:24.348502 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.348359 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t24g\" (UniqueName: \"kubernetes.io/projected/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546-kube-api-access-5t24g\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:05:24.978697 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.978664 2562 generic.go:356] "Generic (PLEG): container finished" podID="e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" containerID="bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720" exitCode=0 Jun 09 00:05:24.979129 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.978701 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7f86c77b-4q2wl" Jun 09 00:05:24.979129 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.978747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7f86c77b-4q2wl" event={"ID":"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546","Type":"ContainerDied","Data":"bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720"} Jun 09 00:05:24.979129 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.978795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7f86c77b-4q2wl" event={"ID":"e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546","Type":"ContainerDied","Data":"69971d4901fcbf7c43a515673c8d5d07609271f3e3ad31b1ba4aa408f50abcf6"} Jun 09 00:05:24.979129 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.978814 2562 scope.go:117] "RemoveContainer" containerID="bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720" Jun 09 00:05:24.988024 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.987999 2562 scope.go:117] "RemoveContainer" containerID="bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720" Jun 09 00:05:24.988295 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:05:24.988273 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720\": container with ID starting with bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720 not found: ID does not exist" containerID="bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720" Jun 09 00:05:24.988350 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:24.988303 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720"} err="failed to get container status \"bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720\": rpc error: code = NotFound desc = could not find container \"bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720\": container with ID starting with bf3ffeb31f9222949bf26811739753c1aaa0422b29e5891c111de5bcbe369720 not found: ID does not exist" Jun 09 00:05:25.000439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:25.000415 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7f86c77b-4q2wl"] Jun 09 00:05:25.003387 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:25.003364 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c7f86c77b-4q2wl"] Jun 09 00:05:25.642448 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:25.642411 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" path="/var/lib/kubelet/pods/e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546/volumes" Jun 09 00:05:59.197040 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.197005 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr"] Jun 09 00:05:59.197435 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.197326 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b6253-8d86-4fcf-a2d6-3e77dcea0700" containerName="image-pruner" Jun 09 00:05:59.197435 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.197338 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b6253-8d86-4fcf-a2d6-3e77dcea0700" containerName="image-pruner" Jun 09 00:05:59.197435 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.197355 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" containerName="console" Jun 09 00:05:59.197435 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.197360 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" containerName="console" Jun 09 00:05:59.197435 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.197415 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e9aa21-1e4d-4197-b6aa-5c71a3aaf546" containerName="console" Jun 09 00:05:59.197435 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.197424 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="552b6253-8d86-4fcf-a2d6-3e77dcea0700" containerName="image-pruner" Jun 09 00:05:59.200473 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.200457 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.202967 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.202937 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:05:59.202967 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.202956 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:05:59.203187 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.202960 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzvpb\"" Jun 09 00:05:59.208644 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.208620 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr"] Jun 09 00:05:59.319593 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.319551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.319823 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.319678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccvz7\" (UniqueName: \"kubernetes.io/projected/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-kube-api-access-ccvz7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.319823 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.319712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.420475 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.420427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccvz7\" (UniqueName: \"kubernetes.io/projected/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-kube-api-access-ccvz7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.420475 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.420481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.420796 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.420548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.420995 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.420972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.421070 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.421007 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.428949 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.428920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccvz7\" (UniqueName: \"kubernetes.io/projected/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-kube-api-access-ccvz7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.510008 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.509970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:05:59.645218 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.645083 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr"] Jun 09 00:05:59.647954 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:05:59.647922 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4eaddea_3f4a_428d_b76c_e5168fc0ee59.slice/crio-5a912c82881d12988875695db14cff078d6285342c9a4cb16e997b961d311747 WatchSource:0}: Error finding container 5a912c82881d12988875695db14cff078d6285342c9a4cb16e997b961d311747: Status 404 returned error can't find the container with id 5a912c82881d12988875695db14cff078d6285342c9a4cb16e997b961d311747 Jun 09 00:05:59.649871 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:05:59.649856 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:06:00.116357 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:00.116320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" event={"ID":"d4eaddea-3f4a-428d-b76c-e5168fc0ee59","Type":"ContainerStarted","Data":"5a912c82881d12988875695db14cff078d6285342c9a4cb16e997b961d311747"} Jun 09 00:06:09.156746 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:09.156709 2562 generic.go:356] "Generic (PLEG): container finished" podID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerID="e29223086fb3b6f2789a283bf6b163980c91441a77b3a7124609c42d78ac4fac" exitCode=0 Jun 09 00:06:09.157224 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:09.156771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" event={"ID":"d4eaddea-3f4a-428d-b76c-e5168fc0ee59","Type":"ContainerDied","Data":"e29223086fb3b6f2789a283bf6b163980c91441a77b3a7124609c42d78ac4fac"} Jun 09 00:06:12.170215 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:12.170170 2562 generic.go:356] "Generic (PLEG): container finished" podID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerID="e3b364813a0b25f560a151866dc9ac1612acbac820e04a426305441692aee839" exitCode=0 Jun 09 00:06:12.170789 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:12.170263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" event={"ID":"d4eaddea-3f4a-428d-b76c-e5168fc0ee59","Type":"ContainerDied","Data":"e3b364813a0b25f560a151866dc9ac1612acbac820e04a426305441692aee839"} Jun 09 00:06:22.214106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:22.214069 2562 generic.go:356] "Generic (PLEG): container finished" podID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerID="b62de2a71b2cf642e390a59b15c9de8fce5730a80cc768d58ad4c1924707c99c" exitCode=0 Jun 09 00:06:22.214515 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:22.214157 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" event={"ID":"d4eaddea-3f4a-428d-b76c-e5168fc0ee59","Type":"ContainerDied","Data":"b62de2a71b2cf642e390a59b15c9de8fce5730a80cc768d58ad4c1924707c99c"} Jun 09 00:06:23.360334 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.360311 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:06:23.425063 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.425038 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-util\") pod \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " Jun 09 00:06:23.425214 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.425077 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccvz7\" (UniqueName: \"kubernetes.io/projected/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-kube-api-access-ccvz7\") pod \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " Jun 09 00:06:23.425214 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.425107 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-bundle\") pod \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\" (UID: \"d4eaddea-3f4a-428d-b76c-e5168fc0ee59\") " Jun 09 00:06:23.425835 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.425803 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-bundle" (OuterVolumeSpecName: "bundle") pod "d4eaddea-3f4a-428d-b76c-e5168fc0ee59" (UID: "d4eaddea-3f4a-428d-b76c-e5168fc0ee59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:06:23.427277 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.427255 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-kube-api-access-ccvz7" (OuterVolumeSpecName: "kube-api-access-ccvz7") pod "d4eaddea-3f4a-428d-b76c-e5168fc0ee59" (UID: "d4eaddea-3f4a-428d-b76c-e5168fc0ee59"). InnerVolumeSpecName "kube-api-access-ccvz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:06:23.429597 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.429573 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-util" (OuterVolumeSpecName: "util") pod "d4eaddea-3f4a-428d-b76c-e5168fc0ee59" (UID: "d4eaddea-3f4a-428d-b76c-e5168fc0ee59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:06:23.526560 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.526527 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:23.526560 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.526558 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccvz7\" (UniqueName: \"kubernetes.io/projected/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-kube-api-access-ccvz7\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:23.526744 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:23.526569 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4eaddea-3f4a-428d-b76c-e5168fc0ee59-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:24.223350 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:24.223319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" event={"ID":"d4eaddea-3f4a-428d-b76c-e5168fc0ee59","Type":"ContainerDied","Data":"5a912c82881d12988875695db14cff078d6285342c9a4cb16e997b961d311747"} Jun 09 00:06:24.223511 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:24.223364 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a912c82881d12988875695db14cff078d6285342c9a4cb16e997b961d311747" Jun 09 00:06:24.223511 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:24.223329 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8bmr" Jun 09 00:06:31.945438 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.945400 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c"] Jun 09 00:06:31.945901 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.945696 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerName="extract" Jun 09 00:06:31.945901 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.945707 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerName="extract" Jun 09 00:06:31.945901 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.945719 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerName="pull" Jun 09 00:06:31.945901 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.945724 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerName="pull" Jun 09 00:06:31.945901 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.945740 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerName="util" Jun 09 00:06:31.945901 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.945745 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerName="util" Jun 09 00:06:31.945901 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.945797 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4eaddea-3f4a-428d-b76c-e5168fc0ee59" containerName="extract" Jun 09 00:06:31.948504 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.948488 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" Jun 09 00:06:31.951073 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.951051 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-trs6d\"" Jun 09 00:06:31.951073 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.951057 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:06:31.951267 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.951057 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 00:06:31.960273 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.960252 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c"] Jun 09 00:06:31.988305 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.988279 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b030037-4010-45d0-90b6-5ee4bc14b312-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p966c\" (UID: \"9b030037-4010-45d0-90b6-5ee4bc14b312\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" Jun 09 00:06:31.988408 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:31.988341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfkvj\" (UniqueName: \"kubernetes.io/projected/9b030037-4010-45d0-90b6-5ee4bc14b312-kube-api-access-bfkvj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p966c\" (UID: \"9b030037-4010-45d0-90b6-5ee4bc14b312\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" Jun 09 00:06:32.088970 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:32.088936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfkvj\" (UniqueName: \"kubernetes.io/projected/9b030037-4010-45d0-90b6-5ee4bc14b312-kube-api-access-bfkvj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p966c\" (UID: \"9b030037-4010-45d0-90b6-5ee4bc14b312\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" Jun 09 00:06:32.089113 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:32.089002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b030037-4010-45d0-90b6-5ee4bc14b312-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p966c\" (UID: \"9b030037-4010-45d0-90b6-5ee4bc14b312\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" Jun 09 00:06:32.089332 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:32.089313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b030037-4010-45d0-90b6-5ee4bc14b312-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p966c\" (UID: \"9b030037-4010-45d0-90b6-5ee4bc14b312\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" Jun 09 00:06:32.105736 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:32.105714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfkvj\" (UniqueName: \"kubernetes.io/projected/9b030037-4010-45d0-90b6-5ee4bc14b312-kube-api-access-bfkvj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p966c\" (UID: \"9b030037-4010-45d0-90b6-5ee4bc14b312\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" Jun 09 00:06:32.257460 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:32.257436 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" Jun 09 00:06:32.381780 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:32.381755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c"] Jun 09 00:06:32.384135 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:06:32.384114 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b030037_4010_45d0_90b6_5ee4bc14b312.slice/crio-942bc94ca03fe7f565169d32bc6275082e3622e7c8673a1c337f859ffe7f2e34 WatchSource:0}: Error finding container 942bc94ca03fe7f565169d32bc6275082e3622e7c8673a1c337f859ffe7f2e34: Status 404 returned error can't find the container with id 942bc94ca03fe7f565169d32bc6275082e3622e7c8673a1c337f859ffe7f2e34 Jun 09 00:06:33.259392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:33.259354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" event={"ID":"9b030037-4010-45d0-90b6-5ee4bc14b312","Type":"ContainerStarted","Data":"942bc94ca03fe7f565169d32bc6275082e3622e7c8673a1c337f859ffe7f2e34"} Jun 09 00:06:34.264746 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:34.264710 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" event={"ID":"9b030037-4010-45d0-90b6-5ee4bc14b312","Type":"ContainerStarted","Data":"19734eff46c6a35ff97105431c3ccdadcbe2d3dc863697df7244f188f1b39a3a"} Jun 09 00:06:34.286561 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:34.286516 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p966c" podStartSLOduration=1.695960382 podStartE2EDuration="3.286501813s" totalImagesPullingTime="1.590541431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:06:34.284107358 +0000 UTC m=+443.106208925" watchObservedRunningTime="2026-06-09 00:06:34.286501813 +0000 UTC m=+443.108603375" Jun 09 00:06:35.625483 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.625440 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l"] Jun 09 00:06:35.630336 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.630314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.632857 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.632838 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:06:35.633897 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.633875 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzvpb\"" Jun 09 00:06:35.633997 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.633900 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:06:35.643921 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.643899 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l"] Jun 09 00:06:35.720817 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.720795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cskfz\" (UniqueName: \"kubernetes.io/projected/04efd1d2-4ca1-4901-b532-db133066d02f-kube-api-access-cskfz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.720902 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.720834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.720902 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.720862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.821524 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.821497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.821655 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.821569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cskfz\" (UniqueName: \"kubernetes.io/projected/04efd1d2-4ca1-4901-b532-db133066d02f-kube-api-access-cskfz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.821655 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.821646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.821880 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.821861 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.821947 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.821926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.829217 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.829197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cskfz\" (UniqueName: \"kubernetes.io/projected/04efd1d2-4ca1-4901-b532-db133066d02f-kube-api-access-cskfz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:35.939538 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:35.939488 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:36.063216 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:36.063191 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l"] Jun 09 00:06:36.065426 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:06:36.065403 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04efd1d2_4ca1_4901_b532_db133066d02f.slice/crio-115ee118208bec22657971628c738d54607019a77d2e70da113568e3ab40fdc5 WatchSource:0}: Error finding container 115ee118208bec22657971628c738d54607019a77d2e70da113568e3ab40fdc5: Status 404 returned error can't find the container with id 115ee118208bec22657971628c738d54607019a77d2e70da113568e3ab40fdc5 Jun 09 00:06:36.273513 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:36.273485 2562 generic.go:356] "Generic (PLEG): container finished" podID="04efd1d2-4ca1-4901-b532-db133066d02f" containerID="2919118fbf5dd3e9fd37dd30410c0b474a23f53e0d45d810db03c90f50f83351" exitCode=0 Jun 09 00:06:36.273664 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:36.273536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" event={"ID":"04efd1d2-4ca1-4901-b532-db133066d02f","Type":"ContainerDied","Data":"2919118fbf5dd3e9fd37dd30410c0b474a23f53e0d45d810db03c90f50f83351"} Jun 09 00:06:36.273664 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:36.273571 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" event={"ID":"04efd1d2-4ca1-4901-b532-db133066d02f","Type":"ContainerStarted","Data":"115ee118208bec22657971628c738d54607019a77d2e70da113568e3ab40fdc5"} Jun 09 00:06:37.508039 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.508000 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw"] Jun 09 00:06:37.511893 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.511867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:37.514392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.514357 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 00:06:37.514392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.514358 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 00:06:37.515441 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.515419 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7nqgc\"" Jun 09 00:06:37.521154 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.521062 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw"] Jun 09 00:06:37.535907 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.535876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz68k\" (UniqueName: \"kubernetes.io/projected/a93e8f77-825f-48e6-aa7f-c238cea73ee0-kube-api-access-rz68k\") pod \"cert-manager-webhook-7dc76cbb94-xrkxw\" (UID: \"a93e8f77-825f-48e6-aa7f-c238cea73ee0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:37.536014 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.535934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a93e8f77-825f-48e6-aa7f-c238cea73ee0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xrkxw\" (UID: \"a93e8f77-825f-48e6-aa7f-c238cea73ee0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:37.636712 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.636673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a93e8f77-825f-48e6-aa7f-c238cea73ee0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xrkxw\" (UID: \"a93e8f77-825f-48e6-aa7f-c238cea73ee0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:37.636922 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.636799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz68k\" (UniqueName: \"kubernetes.io/projected/a93e8f77-825f-48e6-aa7f-c238cea73ee0-kube-api-access-rz68k\") pod \"cert-manager-webhook-7dc76cbb94-xrkxw\" (UID: \"a93e8f77-825f-48e6-aa7f-c238cea73ee0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:37.646320 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.646295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a93e8f77-825f-48e6-aa7f-c238cea73ee0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xrkxw\" (UID: \"a93e8f77-825f-48e6-aa7f-c238cea73ee0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:37.646453 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.646322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz68k\" (UniqueName: \"kubernetes.io/projected/a93e8f77-825f-48e6-aa7f-c238cea73ee0-kube-api-access-rz68k\") pod \"cert-manager-webhook-7dc76cbb94-xrkxw\" (UID: \"a93e8f77-825f-48e6-aa7f-c238cea73ee0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:37.831944 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:37.831865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:38.285595 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.285566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" event={"ID":"04efd1d2-4ca1-4901-b532-db133066d02f","Type":"ContainerStarted","Data":"88ce4cb8f39b5cbbe3ab1c304e8c7c85492e9d847573e7d6801ac3b460554424"} Jun 09 00:06:38.288972 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.288789 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw"] Jun 09 00:06:38.290543 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:06:38.290518 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda93e8f77_825f_48e6_aa7f_c238cea73ee0.slice/crio-1935dcadaf0b1b10b744c4410e961b1e6d5d1817438fffac9ffbf3ce9bf218be WatchSource:0}: Error finding container 1935dcadaf0b1b10b744c4410e961b1e6d5d1817438fffac9ffbf3ce9bf218be: Status 404 returned error can't find the container with id 1935dcadaf0b1b10b744c4410e961b1e6d5d1817438fffac9ffbf3ce9bf218be Jun 09 00:06:38.441524 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.441460 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-22jgl"] Jun 09 00:06:38.444515 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.444500 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" Jun 09 00:06:38.446767 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.446749 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wp792\"" Jun 09 00:06:38.451032 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.451009 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-22jgl"] Jun 09 00:06:38.544840 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.544802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcgnr\" (UniqueName: \"kubernetes.io/projected/ed8cb596-ae0d-44ee-99d4-744c43b6529f-kube-api-access-xcgnr\") pod \"cert-manager-cainjector-5d99449ffd-22jgl\" (UID: \"ed8cb596-ae0d-44ee-99d4-744c43b6529f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" Jun 09 00:06:38.545222 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.544870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed8cb596-ae0d-44ee-99d4-744c43b6529f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-22jgl\" (UID: \"ed8cb596-ae0d-44ee-99d4-744c43b6529f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" Jun 09 00:06:38.645785 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.645748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed8cb596-ae0d-44ee-99d4-744c43b6529f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-22jgl\" (UID: \"ed8cb596-ae0d-44ee-99d4-744c43b6529f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" Jun 09 00:06:38.645928 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.645837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcgnr\" (UniqueName: \"kubernetes.io/projected/ed8cb596-ae0d-44ee-99d4-744c43b6529f-kube-api-access-xcgnr\") pod \"cert-manager-cainjector-5d99449ffd-22jgl\" (UID: \"ed8cb596-ae0d-44ee-99d4-744c43b6529f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" Jun 09 00:06:38.654395 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.654360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed8cb596-ae0d-44ee-99d4-744c43b6529f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-22jgl\" (UID: \"ed8cb596-ae0d-44ee-99d4-744c43b6529f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" Jun 09 00:06:38.654533 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.654508 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcgnr\" (UniqueName: \"kubernetes.io/projected/ed8cb596-ae0d-44ee-99d4-744c43b6529f-kube-api-access-xcgnr\") pod \"cert-manager-cainjector-5d99449ffd-22jgl\" (UID: \"ed8cb596-ae0d-44ee-99d4-744c43b6529f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" Jun 09 00:06:38.754093 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.754066 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" Jun 09 00:06:38.880288 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:38.880263 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-22jgl"] Jun 09 00:06:38.881849 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:06:38.881813 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded8cb596_ae0d_44ee_99d4_744c43b6529f.slice/crio-e613a0b0fc58190515982e889f6ed2f668b7641f73b19b183a2c2d1ca2166e14 WatchSource:0}: Error finding container e613a0b0fc58190515982e889f6ed2f668b7641f73b19b183a2c2d1ca2166e14: Status 404 returned error can't find the container with id e613a0b0fc58190515982e889f6ed2f668b7641f73b19b183a2c2d1ca2166e14 Jun 09 00:06:39.298796 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:39.298753 2562 generic.go:356] "Generic (PLEG): container finished" podID="04efd1d2-4ca1-4901-b532-db133066d02f" containerID="88ce4cb8f39b5cbbe3ab1c304e8c7c85492e9d847573e7d6801ac3b460554424" exitCode=0 Jun 09 00:06:39.298970 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:39.298802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" event={"ID":"04efd1d2-4ca1-4901-b532-db133066d02f","Type":"ContainerDied","Data":"88ce4cb8f39b5cbbe3ab1c304e8c7c85492e9d847573e7d6801ac3b460554424"} Jun 09 00:06:39.300271 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:39.300240 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" event={"ID":"ed8cb596-ae0d-44ee-99d4-744c43b6529f","Type":"ContainerStarted","Data":"e613a0b0fc58190515982e889f6ed2f668b7641f73b19b183a2c2d1ca2166e14"} Jun 09 00:06:39.301529 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:39.301505 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" event={"ID":"a93e8f77-825f-48e6-aa7f-c238cea73ee0","Type":"ContainerStarted","Data":"1935dcadaf0b1b10b744c4410e961b1e6d5d1817438fffac9ffbf3ce9bf218be"} Jun 09 00:06:40.309806 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:40.309765 2562 generic.go:356] "Generic (PLEG): container finished" podID="04efd1d2-4ca1-4901-b532-db133066d02f" containerID="97087e34ab64acd9e31d01d7d08bbe46a2fe4738644a1a9083012a45eceb2e75" exitCode=0 Jun 09 00:06:40.310226 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:40.309836 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" event={"ID":"04efd1d2-4ca1-4901-b532-db133066d02f","Type":"ContainerDied","Data":"97087e34ab64acd9e31d01d7d08bbe46a2fe4738644a1a9083012a45eceb2e75"} Jun 09 00:06:41.316824 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.316733 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" event={"ID":"ed8cb596-ae0d-44ee-99d4-744c43b6529f","Type":"ContainerStarted","Data":"b3635b8d646faa47573f6b8469e2e9e3464fe1bb0a1a6627b4c6860b5c62c001"} Jun 09 00:06:41.318386 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.318356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" event={"ID":"a93e8f77-825f-48e6-aa7f-c238cea73ee0","Type":"ContainerStarted","Data":"af2dbdc6280027add0af413e2149c86674b3b4b80f70bc37f7eee92759b1bd12"} Jun 09 00:06:41.318623 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.318582 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:41.333445 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.333392 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-22jgl" podStartSLOduration=1.189392142 podStartE2EDuration="3.333377571s" totalImagesPullingTime="2.143985429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:06:41.331662626 +0000 UTC m=+450.153764182" watchObservedRunningTime="2026-06-09 00:06:41.333377571 +0000 UTC m=+450.155479132" Jun 09 00:06:41.348534 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.348481 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" podStartSLOduration=1.620125126 podStartE2EDuration="4.348461585s" totalImagesPullingTime="2.728336459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:06:41.347261656 +0000 UTC m=+450.169363219" watchObservedRunningTime="2026-06-09 00:06:41.348461585 +0000 UTC m=+450.170563148" Jun 09 00:06:41.452017 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.451993 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:41.573927 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.573848 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-util\") pod \"04efd1d2-4ca1-4901-b532-db133066d02f\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " Jun 09 00:06:41.574069 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.573934 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cskfz\" (UniqueName: \"kubernetes.io/projected/04efd1d2-4ca1-4901-b532-db133066d02f-kube-api-access-cskfz\") pod \"04efd1d2-4ca1-4901-b532-db133066d02f\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " Jun 09 00:06:41.574069 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.573958 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-bundle\") pod \"04efd1d2-4ca1-4901-b532-db133066d02f\" (UID: \"04efd1d2-4ca1-4901-b532-db133066d02f\") " Jun 09 00:06:41.574383 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.574356 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-bundle" (OuterVolumeSpecName: "bundle") pod "04efd1d2-4ca1-4901-b532-db133066d02f" (UID: "04efd1d2-4ca1-4901-b532-db133066d02f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:06:41.576097 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.576065 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04efd1d2-4ca1-4901-b532-db133066d02f-kube-api-access-cskfz" (OuterVolumeSpecName: "kube-api-access-cskfz") pod "04efd1d2-4ca1-4901-b532-db133066d02f" (UID: "04efd1d2-4ca1-4901-b532-db133066d02f"). InnerVolumeSpecName "kube-api-access-cskfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:06:41.577905 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.577883 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-util" (OuterVolumeSpecName: "util") pod "04efd1d2-4ca1-4901-b532-db133066d02f" (UID: "04efd1d2-4ca1-4901-b532-db133066d02f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:06:41.674723 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.674699 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:41.674723 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.674722 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cskfz\" (UniqueName: \"kubernetes.io/projected/04efd1d2-4ca1-4901-b532-db133066d02f-kube-api-access-cskfz\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:41.674843 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:41.674736 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04efd1d2-4ca1-4901-b532-db133066d02f-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:42.325000 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:42.324975 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" Jun 09 00:06:42.325000 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:42.324990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f86w7l" event={"ID":"04efd1d2-4ca1-4901-b532-db133066d02f","Type":"ContainerDied","Data":"115ee118208bec22657971628c738d54607019a77d2e70da113568e3ab40fdc5"} Jun 09 00:06:42.325425 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:42.325035 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="115ee118208bec22657971628c738d54607019a77d2e70da113568e3ab40fdc5" Jun 09 00:06:46.236994 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.236960 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc"] Jun 09 00:06:46.237338 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.237251 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04efd1d2-4ca1-4901-b532-db133066d02f" containerName="extract" Jun 09 00:06:46.237338 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.237264 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04efd1d2-4ca1-4901-b532-db133066d02f" containerName="extract" Jun 09 00:06:46.237338 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.237280 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04efd1d2-4ca1-4901-b532-db133066d02f" containerName="util" Jun 09 00:06:46.237338 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.237285 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04efd1d2-4ca1-4901-b532-db133066d02f" containerName="util" Jun 09 00:06:46.237338 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.237298 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04efd1d2-4ca1-4901-b532-db133066d02f" containerName="pull" Jun 09 00:06:46.237338 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.237304 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04efd1d2-4ca1-4901-b532-db133066d02f" containerName="pull" Jun 09 00:06:46.237528 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.237352 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04efd1d2-4ca1-4901-b532-db133066d02f" containerName="extract" Jun 09 00:06:46.241358 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.241341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" Jun 09 00:06:46.243809 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.243787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qzchf\"" Jun 09 00:06:46.243916 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.243823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:06:46.245165 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.245141 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 00:06:46.247103 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.247083 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc"] Jun 09 00:06:46.309765 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.309743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b4dd0de-21a4-4c74-905d-abb8baa52763-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7jhjc\" (UID: \"8b4dd0de-21a4-4c74-905d-abb8baa52763\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" Jun 09 00:06:46.309875 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.309779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn452\" (UniqueName: \"kubernetes.io/projected/8b4dd0de-21a4-4c74-905d-abb8baa52763-kube-api-access-kn452\") pod \"openshift-lws-operator-fd8ccff4c-7jhjc\" (UID: \"8b4dd0de-21a4-4c74-905d-abb8baa52763\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" Jun 09 00:06:46.410979 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.410957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b4dd0de-21a4-4c74-905d-abb8baa52763-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7jhjc\" (UID: \"8b4dd0de-21a4-4c74-905d-abb8baa52763\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" Jun 09 00:06:46.411077 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.410991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn452\" (UniqueName: \"kubernetes.io/projected/8b4dd0de-21a4-4c74-905d-abb8baa52763-kube-api-access-kn452\") pod \"openshift-lws-operator-fd8ccff4c-7jhjc\" (UID: \"8b4dd0de-21a4-4c74-905d-abb8baa52763\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" Jun 09 00:06:46.411305 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.411283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b4dd0de-21a4-4c74-905d-abb8baa52763-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7jhjc\" (UID: \"8b4dd0de-21a4-4c74-905d-abb8baa52763\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" Jun 09 00:06:46.418736 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.418710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn452\" (UniqueName: \"kubernetes.io/projected/8b4dd0de-21a4-4c74-905d-abb8baa52763-kube-api-access-kn452\") pod \"openshift-lws-operator-fd8ccff4c-7jhjc\" (UID: \"8b4dd0de-21a4-4c74-905d-abb8baa52763\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" Jun 09 00:06:46.550681 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.550599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" Jun 09 00:06:46.674352 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:46.674325 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc"] Jun 09 00:06:46.677166 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:06:46.677144 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b4dd0de_21a4_4c74_905d_abb8baa52763.slice/crio-f0231a53124256e6650202ca854edf222708828ca439fdc69a74156eae9e95e2 WatchSource:0}: Error finding container f0231a53124256e6650202ca854edf222708828ca439fdc69a74156eae9e95e2: Status 404 returned error can't find the container with id f0231a53124256e6650202ca854edf222708828ca439fdc69a74156eae9e95e2 Jun 09 00:06:47.348749 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.348717 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" event={"ID":"8b4dd0de-21a4-4c74-905d-abb8baa52763","Type":"ContainerStarted","Data":"f0231a53124256e6650202ca854edf222708828ca439fdc69a74156eae9e95e2"} Jun 09 00:06:47.545780 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.545743 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-6cr4h"] Jun 09 00:06:47.549500 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.549478 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-6cr4h" Jun 09 00:06:47.552209 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.552187 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9897x\"" Jun 09 00:06:47.556228 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.556185 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-6cr4h"] Jun 09 00:06:47.620761 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.620705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs65z\" (UniqueName: \"kubernetes.io/projected/15c1d654-cc41-4e82-a6e0-49256508c86c-kube-api-access-bs65z\") pod \"cert-manager-59c77684cc-6cr4h\" (UID: \"15c1d654-cc41-4e82-a6e0-49256508c86c\") " pod="cert-manager/cert-manager-59c77684cc-6cr4h" Jun 09 00:06:47.620761 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.620743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15c1d654-cc41-4e82-a6e0-49256508c86c-bound-sa-token\") pod \"cert-manager-59c77684cc-6cr4h\" (UID: \"15c1d654-cc41-4e82-a6e0-49256508c86c\") " pod="cert-manager/cert-manager-59c77684cc-6cr4h" Jun 09 00:06:47.721903 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.721876 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs65z\" (UniqueName: \"kubernetes.io/projected/15c1d654-cc41-4e82-a6e0-49256508c86c-kube-api-access-bs65z\") pod \"cert-manager-59c77684cc-6cr4h\" (UID: \"15c1d654-cc41-4e82-a6e0-49256508c86c\") " pod="cert-manager/cert-manager-59c77684cc-6cr4h" Jun 09 00:06:47.722012 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.721914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15c1d654-cc41-4e82-a6e0-49256508c86c-bound-sa-token\") pod \"cert-manager-59c77684cc-6cr4h\" (UID: \"15c1d654-cc41-4e82-a6e0-49256508c86c\") " pod="cert-manager/cert-manager-59c77684cc-6cr4h" Jun 09 00:06:47.732894 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.732868 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15c1d654-cc41-4e82-a6e0-49256508c86c-bound-sa-token\") pod \"cert-manager-59c77684cc-6cr4h\" (UID: \"15c1d654-cc41-4e82-a6e0-49256508c86c\") " pod="cert-manager/cert-manager-59c77684cc-6cr4h" Jun 09 00:06:47.733016 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.732917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs65z\" (UniqueName: \"kubernetes.io/projected/15c1d654-cc41-4e82-a6e0-49256508c86c-kube-api-access-bs65z\") pod \"cert-manager-59c77684cc-6cr4h\" (UID: \"15c1d654-cc41-4e82-a6e0-49256508c86c\") " pod="cert-manager/cert-manager-59c77684cc-6cr4h" Jun 09 00:06:47.862852 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:47.862820 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-6cr4h" Jun 09 00:06:48.332791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:48.332770 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xrkxw" Jun 09 00:06:48.409085 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:48.409048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-6cr4h"] Jun 09 00:06:48.411696 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:06:48.411660 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15c1d654_cc41_4e82_a6e0_49256508c86c.slice/crio-588f8c74a0c237fe924eda601d3bc8f40d715eb759715473c434a0370f57ed5b WatchSource:0}: Error finding container 588f8c74a0c237fe924eda601d3bc8f40d715eb759715473c434a0370f57ed5b: Status 404 returned error can't find the container with id 588f8c74a0c237fe924eda601d3bc8f40d715eb759715473c434a0370f57ed5b Jun 09 00:06:49.370046 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:49.370005 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" event={"ID":"8b4dd0de-21a4-4c74-905d-abb8baa52763","Type":"ContainerStarted","Data":"eddb8852acfdb7176d7236dca4b102f598cd6eab326634308c7e16d55fc11b55"} Jun 09 00:06:49.371510 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:49.371484 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-6cr4h" event={"ID":"15c1d654-cc41-4e82-a6e0-49256508c86c","Type":"ContainerStarted","Data":"feb3c78687e4a7697d8f82b95151ff97b26423195470771a7c6acdc49d4559a3"} Jun 09 00:06:49.371695 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:49.371544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-6cr4h" event={"ID":"15c1d654-cc41-4e82-a6e0-49256508c86c","Type":"ContainerStarted","Data":"588f8c74a0c237fe924eda601d3bc8f40d715eb759715473c434a0370f57ed5b"} Jun 09 00:06:49.387258 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:49.387207 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7jhjc" podStartSLOduration=1.725492138 podStartE2EDuration="3.387195025s" totalImagesPullingTime="1.661702887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:06:49.386730735 +0000 UTC m=+458.208832298" watchObservedRunningTime="2026-06-09 00:06:49.387195025 +0000 UTC m=+458.209296586" Jun 09 00:06:49.403637 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:49.403584 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-6cr4h" podStartSLOduration=2.403573121 podStartE2EDuration="2.403573121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:06:49.402209499 +0000 UTC m=+458.224311073" watchObservedRunningTime="2026-06-09 00:06:49.403573121 +0000 UTC m=+458.225674683" Jun 09 00:06:51.942703 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:51.942668 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58"] Jun 09 00:06:51.991349 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:51.991316 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58"] Jun 09 00:06:51.991510 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:51.991410 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:51.993835 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:51.993812 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:06:51.993984 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:51.993862 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzvpb\"" Jun 09 00:06:51.994844 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:51.994822 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:06:52.054302 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.054258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.054302 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.054310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmlkx\" (UniqueName: \"kubernetes.io/projected/63d13da0-eb49-4d03-b6cd-292aa0618039-kube-api-access-xmlkx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.054486 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.054406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.154803 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.154773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.154955 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.154813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmlkx\" (UniqueName: \"kubernetes.io/projected/63d13da0-eb49-4d03-b6cd-292aa0618039-kube-api-access-xmlkx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.154955 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.154889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.155182 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.155162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.155218 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.155194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.163349 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.163320 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmlkx\" (UniqueName: \"kubernetes.io/projected/63d13da0-eb49-4d03-b6cd-292aa0618039-kube-api-access-xmlkx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.301007 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.300962 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:52.446069 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:52.446037 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58"] Jun 09 00:06:52.448239 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:06:52.448209 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d13da0_eb49_4d03_b6cd_292aa0618039.slice/crio-3a73b33af4862bcd31476b11b6e1441279ac8c6074033074f6ef21b76868c6bf WatchSource:0}: Error finding container 3a73b33af4862bcd31476b11b6e1441279ac8c6074033074f6ef21b76868c6bf: Status 404 returned error can't find the container with id 3a73b33af4862bcd31476b11b6e1441279ac8c6074033074f6ef21b76868c6bf Jun 09 00:06:53.393542 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:53.393509 2562 generic.go:356] "Generic (PLEG): container finished" podID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerID="95c5ab1972abfadcccfdb9de9fe0628561a8d1e3ba592d0a8312d43de01f97ab" exitCode=0 Jun 09 00:06:53.393948 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:53.393595 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" event={"ID":"63d13da0-eb49-4d03-b6cd-292aa0618039","Type":"ContainerDied","Data":"95c5ab1972abfadcccfdb9de9fe0628561a8d1e3ba592d0a8312d43de01f97ab"} Jun 09 00:06:53.393948 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:53.393664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" event={"ID":"63d13da0-eb49-4d03-b6cd-292aa0618039","Type":"ContainerStarted","Data":"3a73b33af4862bcd31476b11b6e1441279ac8c6074033074f6ef21b76868c6bf"} Jun 09 00:06:55.404748 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:55.404712 2562 generic.go:356] "Generic (PLEG): container finished" podID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerID="dc5e6a47b5cf03ae2203da29731f4554a4263501ebb1635471082215a97bcbc7" exitCode=0 Jun 09 00:06:55.404748 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:55.404750 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" event={"ID":"63d13da0-eb49-4d03-b6cd-292aa0618039","Type":"ContainerDied","Data":"dc5e6a47b5cf03ae2203da29731f4554a4263501ebb1635471082215a97bcbc7"} Jun 09 00:06:56.415272 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:56.415227 2562 generic.go:356] "Generic (PLEG): container finished" podID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerID="9241e16dc81dac3f425ab575495aa73516084bb0bc036fc6390713f8cc316de7" exitCode=0 Jun 09 00:06:56.415644 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:56.415306 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" event={"ID":"63d13da0-eb49-4d03-b6cd-292aa0618039","Type":"ContainerDied","Data":"9241e16dc81dac3f425ab575495aa73516084bb0bc036fc6390713f8cc316de7"} Jun 09 00:06:57.545250 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.545228 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:57.701221 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.701157 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-util\") pod \"63d13da0-eb49-4d03-b6cd-292aa0618039\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " Jun 09 00:06:57.701221 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.701191 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmlkx\" (UniqueName: \"kubernetes.io/projected/63d13da0-eb49-4d03-b6cd-292aa0618039-kube-api-access-xmlkx\") pod \"63d13da0-eb49-4d03-b6cd-292aa0618039\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " Jun 09 00:06:57.701428 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.701255 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-bundle\") pod \"63d13da0-eb49-4d03-b6cd-292aa0618039\" (UID: \"63d13da0-eb49-4d03-b6cd-292aa0618039\") " Jun 09 00:06:57.701953 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.701929 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-bundle" (OuterVolumeSpecName: "bundle") pod "63d13da0-eb49-4d03-b6cd-292aa0618039" (UID: "63d13da0-eb49-4d03-b6cd-292aa0618039"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:06:57.703331 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.703302 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d13da0-eb49-4d03-b6cd-292aa0618039-kube-api-access-xmlkx" (OuterVolumeSpecName: "kube-api-access-xmlkx") pod "63d13da0-eb49-4d03-b6cd-292aa0618039" (UID: "63d13da0-eb49-4d03-b6cd-292aa0618039"). InnerVolumeSpecName "kube-api-access-xmlkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:06:57.727089 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.727069 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-util" (OuterVolumeSpecName: "util") pod "63d13da0-eb49-4d03-b6cd-292aa0618039" (UID: "63d13da0-eb49-4d03-b6cd-292aa0618039"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:06:57.801781 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.801753 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:57.801781 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.801776 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63d13da0-eb49-4d03-b6cd-292aa0618039-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:57.801908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:57.801787 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmlkx\" (UniqueName: \"kubernetes.io/projected/63d13da0-eb49-4d03-b6cd-292aa0618039-kube-api-access-xmlkx\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:06:58.426504 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:58.426470 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" Jun 09 00:06:58.426504 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:58.426494 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc5r58" event={"ID":"63d13da0-eb49-4d03-b6cd-292aa0618039","Type":"ContainerDied","Data":"3a73b33af4862bcd31476b11b6e1441279ac8c6074033074f6ef21b76868c6bf"} Jun 09 00:06:58.426737 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:06:58.426542 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a73b33af4862bcd31476b11b6e1441279ac8c6074033074f6ef21b76868c6bf" Jun 09 00:07:08.590200 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.590164 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8"] Jun 09 00:07:08.590791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.590643 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerName="extract" Jun 09 00:07:08.590791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.590661 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerName="extract" Jun 09 00:07:08.590791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.590699 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerName="pull" Jun 09 00:07:08.590791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.590708 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerName="pull" Jun 09 00:07:08.590791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.590722 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerName="util" Jun 09 00:07:08.590791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.590730 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerName="util" Jun 09 00:07:08.591101 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.590808 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d13da0-eb49-4d03-b6cd-292aa0618039" containerName="extract" Jun 09 00:07:08.594026 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.594004 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.598259 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.598232 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 00:07:08.599676 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.599656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 00:07:08.599791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.599708 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 00:07:08.600822 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.600779 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zkkk7\"" Jun 09 00:07:08.600993 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.600968 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 00:07:08.628882 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.628863 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8"] Jun 09 00:07:08.694067 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.694043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0121ebaf-1976-4c01-9785-7b4b7387f472-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.694166 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.694075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0121ebaf-1976-4c01-9785-7b4b7387f472-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.694166 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.694103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0121ebaf-1976-4c01-9785-7b4b7387f472-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.694246 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.694204 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0121ebaf-1976-4c01-9785-7b4b7387f472-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.694246 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.694237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf6gw\" (UniqueName: \"kubernetes.io/projected/0121ebaf-1976-4c01-9785-7b4b7387f472-kube-api-access-cf6gw\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.795529 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.795481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0121ebaf-1976-4c01-9785-7b4b7387f472-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.795643 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.795542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0121ebaf-1976-4c01-9785-7b4b7387f472-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.795643 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.795586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0121ebaf-1976-4c01-9785-7b4b7387f472-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.795746 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.795655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0121ebaf-1976-4c01-9785-7b4b7387f472-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.795746 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.795677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf6gw\" (UniqueName: \"kubernetes.io/projected/0121ebaf-1976-4c01-9785-7b4b7387f472-kube-api-access-cf6gw\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.796006 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.795986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0121ebaf-1976-4c01-9785-7b4b7387f472-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.797842 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.797823 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0121ebaf-1976-4c01-9785-7b4b7387f472-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.797974 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.797958 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0121ebaf-1976-4c01-9785-7b4b7387f472-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.798057 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.798038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0121ebaf-1976-4c01-9785-7b4b7387f472-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.802568 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.802545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf6gw\" (UniqueName: \"kubernetes.io/projected/0121ebaf-1976-4c01-9785-7b4b7387f472-kube-api-access-cf6gw\") pod \"opendatahub-operator-controller-manager-569d667bc9-dmbv8\" (UID: \"0121ebaf-1976-4c01-9785-7b4b7387f472\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:08.905452 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:08.905393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:09.039176 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:09.039153 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8"] Jun 09 00:07:09.041275 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:07:09.041250 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0121ebaf_1976_4c01_9785_7b4b7387f472.slice/crio-6b91831b94558cfb09ed836d267abea830dff8583d9dd2818b9613f087a80672 WatchSource:0}: Error finding container 6b91831b94558cfb09ed836d267abea830dff8583d9dd2818b9613f087a80672: Status 404 returned error can't find the container with id 6b91831b94558cfb09ed836d267abea830dff8583d9dd2818b9613f087a80672 Jun 09 00:07:09.476351 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:09.476316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" event={"ID":"0121ebaf-1976-4c01-9785-7b4b7387f472","Type":"ContainerStarted","Data":"6b91831b94558cfb09ed836d267abea830dff8583d9dd2818b9613f087a80672"} Jun 09 00:07:13.501043 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:13.501005 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" event={"ID":"0121ebaf-1976-4c01-9785-7b4b7387f472","Type":"ContainerStarted","Data":"ec61beebdf0a2ced79a80f081d1d0f4cec663035a37b76a08cbd0f64154cfd31"} Jun 09 00:07:14.507378 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:14.507342 2562 generic.go:356] "Generic (PLEG): container finished" podID="0121ebaf-1976-4c01-9785-7b4b7387f472" containerID="ec61beebdf0a2ced79a80f081d1d0f4cec663035a37b76a08cbd0f64154cfd31" exitCode=0 Jun 09 00:07:14.507787 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:14.507433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" event={"ID":"0121ebaf-1976-4c01-9785-7b4b7387f472","Type":"ContainerDied","Data":"ec61beebdf0a2ced79a80f081d1d0f4cec663035a37b76a08cbd0f64154cfd31"} Jun 09 00:07:15.513666 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:15.513625 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" event={"ID":"0121ebaf-1976-4c01-9785-7b4b7387f472","Type":"ContainerStarted","Data":"f62fe23f23eb1425cc07d98922f7235df01ef5361c5cc9e33d06602462bda229"} Jun 09 00:07:15.514143 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:15.513757 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:15.536751 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:15.536673 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" podStartSLOduration=2.336512458 podStartE2EDuration="7.536659221s" totalImagesPullingTime="4.209466051s" totalInitContainerRuntime="990.680712ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:15.533789923 +0000 UTC m=+484.355891486" watchObservedRunningTime="2026-06-09 00:07:15.536659221 +0000 UTC m=+484.358760783" Jun 09 00:07:26.520939 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:26.520912 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-dmbv8" Jun 09 00:07:33.897024 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.896993 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8659c84586-zm46c"] Jun 09 00:07:33.900826 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.900803 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:33.903493 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.903469 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g7f7v\"" Jun 09 00:07:33.903637 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.903468 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 00:07:33.903637 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.903475 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 00:07:33.904523 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.904508 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 00:07:33.904578 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.904511 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 00:07:33.910949 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.910925 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8659c84586-zm46c"] Jun 09 00:07:33.999989 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.999966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7a45a46-a634-458d-a5e5-8fb4013ea70a-tmp\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.000113 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:33.999993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn66q\" (UniqueName: \"kubernetes.io/projected/c7a45a46-a634-458d-a5e5-8fb4013ea70a-kube-api-access-zn66q\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.000113 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.000101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7a45a46-a634-458d-a5e5-8fb4013ea70a-tls-certs\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.101423 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.101390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7a45a46-a634-458d-a5e5-8fb4013ea70a-tls-certs\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.101566 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.101436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7a45a46-a634-458d-a5e5-8fb4013ea70a-tmp\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.101566 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.101460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn66q\" (UniqueName: \"kubernetes.io/projected/c7a45a46-a634-458d-a5e5-8fb4013ea70a-kube-api-access-zn66q\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.103717 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.103691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7a45a46-a634-458d-a5e5-8fb4013ea70a-tmp\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.103954 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.103934 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7a45a46-a634-458d-a5e5-8fb4013ea70a-tls-certs\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.108728 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.108706 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn66q\" (UniqueName: \"kubernetes.io/projected/c7a45a46-a634-458d-a5e5-8fb4013ea70a-kube-api-access-zn66q\") pod \"kube-auth-proxy-8659c84586-zm46c\" (UID: \"c7a45a46-a634-458d-a5e5-8fb4013ea70a\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.211724 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.211674 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" Jun 09 00:07:34.342560 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.342534 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8659c84586-zm46c"] Jun 09 00:07:34.345247 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:07:34.345218 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a45a46_a634_458d_a5e5_8fb4013ea70a.slice/crio-1742738ac351a78d722ba0acb7382833aa1a3fea3a065338dc86220698f30bf0 WatchSource:0}: Error finding container 1742738ac351a78d722ba0acb7382833aa1a3fea3a065338dc86220698f30bf0: Status 404 returned error can't find the container with id 1742738ac351a78d722ba0acb7382833aa1a3fea3a065338dc86220698f30bf0 Jun 09 00:07:34.603842 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:34.603807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" event={"ID":"c7a45a46-a634-458d-a5e5-8fb4013ea70a","Type":"ContainerStarted","Data":"1742738ac351a78d722ba0acb7382833aa1a3fea3a065338dc86220698f30bf0"} Jun 09 00:07:35.621133 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.621095 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22"] Jun 09 00:07:35.625047 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.625023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.627864 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.627841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzvpb\"" Jun 09 00:07:35.628007 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.627888 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:07:35.628192 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.628109 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:07:35.632739 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.632706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22"] Jun 09 00:07:35.716738 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.716702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.716929 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.716753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm7r4\" (UniqueName: \"kubernetes.io/projected/3aea16de-01e4-4615-b83a-a14f50cee3c7-kube-api-access-fm7r4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.716929 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.716886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.818232 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.818182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.818396 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.818273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.818396 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.818301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm7r4\" (UniqueName: \"kubernetes.io/projected/3aea16de-01e4-4615-b83a-a14f50cee3c7-kube-api-access-fm7r4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.819000 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.818949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.819125 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.818998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.832399 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.832371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm7r4\" (UniqueName: \"kubernetes.io/projected/3aea16de-01e4-4615-b83a-a14f50cee3c7-kube-api-access-fm7r4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:35.937921 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:35.937830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:36.529454 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:36.529432 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22"] Jun 09 00:07:36.531104 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:07:36.531068 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aea16de_01e4_4615_b83a_a14f50cee3c7.slice/crio-06968c9f107a117308e7533a6637831a394eb970b8eb994e71e62c0ea49cf47f WatchSource:0}: Error finding container 06968c9f107a117308e7533a6637831a394eb970b8eb994e71e62c0ea49cf47f: Status 404 returned error can't find the container with id 06968c9f107a117308e7533a6637831a394eb970b8eb994e71e62c0ea49cf47f Jun 09 00:07:36.617695 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:36.617658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" event={"ID":"3aea16de-01e4-4615-b83a-a14f50cee3c7","Type":"ContainerStarted","Data":"7cfdf6e74b8aa1887ead2e49aac64f63c4489de45e9edb6e51f6aba228813b30"} Jun 09 00:07:36.617808 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:36.617724 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" event={"ID":"3aea16de-01e4-4615-b83a-a14f50cee3c7","Type":"ContainerStarted","Data":"06968c9f107a117308e7533a6637831a394eb970b8eb994e71e62c0ea49cf47f"} Jun 09 00:07:37.636249 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.636218 2562 generic.go:356] "Generic (PLEG): container finished" podID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerID="7cfdf6e74b8aa1887ead2e49aac64f63c4489de45e9edb6e51f6aba228813b30" exitCode=0 Jun 09 00:07:37.636637 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.636277 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" event={"ID":"3aea16de-01e4-4615-b83a-a14f50cee3c7","Type":"ContainerDied","Data":"7cfdf6e74b8aa1887ead2e49aac64f63c4489de45e9edb6e51f6aba228813b30"} Jun 09 00:07:37.907160 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.907080 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d"] Jun 09 00:07:37.910697 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.910676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:37.919355 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.918975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-np6xr\"" Jun 09 00:07:37.919355 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.919068 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 00:07:37.919355 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.919196 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 00:07:37.919355 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.919262 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 00:07:37.926347 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:37.926309 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d"] Jun 09 00:07:38.038300 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.038264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/59b348e7-6464-4e82-b009-cf2ec3186f7b-manager-config\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.038469 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.038318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb845\" (UniqueName: \"kubernetes.io/projected/59b348e7-6464-4e82-b009-cf2ec3186f7b-kube-api-access-mb845\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.038469 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.038372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/59b348e7-6464-4e82-b009-cf2ec3186f7b-metrics-cert\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.038469 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.038400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59b348e7-6464-4e82-b009-cf2ec3186f7b-cert\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.139275 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.139230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/59b348e7-6464-4e82-b009-cf2ec3186f7b-manager-config\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.139439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.139306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb845\" (UniqueName: \"kubernetes.io/projected/59b348e7-6464-4e82-b009-cf2ec3186f7b-kube-api-access-mb845\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.139439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.139349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/59b348e7-6464-4e82-b009-cf2ec3186f7b-metrics-cert\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.139439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.139376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59b348e7-6464-4e82-b009-cf2ec3186f7b-cert\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.140062 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.140034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/59b348e7-6464-4e82-b009-cf2ec3186f7b-manager-config\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.141919 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.141894 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59b348e7-6464-4e82-b009-cf2ec3186f7b-cert\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.142045 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.141980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/59b348e7-6464-4e82-b009-cf2ec3186f7b-metrics-cert\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.152596 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.152575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb845\" (UniqueName: \"kubernetes.io/projected/59b348e7-6464-4e82-b009-cf2ec3186f7b-kube-api-access-mb845\") pod \"lws-controller-manager-5f4484c748-w5s6d\" (UID: \"59b348e7-6464-4e82-b009-cf2ec3186f7b\") " pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.230656 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.230556 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:38.360304 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.360282 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d"] Jun 09 00:07:38.362351 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:07:38.362329 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b348e7_6464_4e82_b009_cf2ec3186f7b.slice/crio-23e6fcf1710cb0490790b2a143c753469bf6fd15e4dc1141fded2a39c8627be4 WatchSource:0}: Error finding container 23e6fcf1710cb0490790b2a143c753469bf6fd15e4dc1141fded2a39c8627be4: Status 404 returned error can't find the container with id 23e6fcf1710cb0490790b2a143c753469bf6fd15e4dc1141fded2a39c8627be4 Jun 09 00:07:38.642481 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.642452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" event={"ID":"59b348e7-6464-4e82-b009-cf2ec3186f7b","Type":"ContainerStarted","Data":"23e6fcf1710cb0490790b2a143c753469bf6fd15e4dc1141fded2a39c8627be4"} Jun 09 00:07:38.643873 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.643848 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" event={"ID":"c7a45a46-a634-458d-a5e5-8fb4013ea70a","Type":"ContainerStarted","Data":"fe75f78765ebb9beff86590832e3137e2185771b2cf1c3a568d5135ae45e0cfb"} Jun 09 00:07:38.645671 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.645647 2562 generic.go:356] "Generic (PLEG): container finished" podID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerID="a66e59c27ebff62f6a3e94013d351e666924eb74d784ef2fd3736c302bd1c0b3" exitCode=0 Jun 09 00:07:38.645778 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.645742 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" event={"ID":"3aea16de-01e4-4615-b83a-a14f50cee3c7","Type":"ContainerDied","Data":"a66e59c27ebff62f6a3e94013d351e666924eb74d784ef2fd3736c302bd1c0b3"} Jun 09 00:07:38.673650 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:38.673576 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8659c84586-zm46c" podStartSLOduration=2.386053592 podStartE2EDuration="5.673562625s" totalImagesPullingTime="3.287509033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:38.671464334 +0000 UTC m=+507.493565897" watchObservedRunningTime="2026-06-09 00:07:38.673562625 +0000 UTC m=+507.495664187" Jun 09 00:07:39.653737 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:39.653703 2562 generic.go:356] "Generic (PLEG): container finished" podID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerID="9c1432ee43a294552bf5c5fd8a300f0920727081a2003704589c0499ff655ae6" exitCode=0 Jun 09 00:07:39.654289 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:39.653802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" event={"ID":"3aea16de-01e4-4615-b83a-a14f50cee3c7","Type":"ContainerDied","Data":"9c1432ee43a294552bf5c5fd8a300f0920727081a2003704589c0499ff655ae6"} Jun 09 00:07:40.660729 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.660688 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" event={"ID":"59b348e7-6464-4e82-b009-cf2ec3186f7b","Type":"ContainerStarted","Data":"30568d5aabe54a2f98f514f20ae49222612d8b0e7432b9d9409472a311942306"} Jun 09 00:07:40.661192 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.661014 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:40.682268 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.682217 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" podStartSLOduration=2.158138284 podStartE2EDuration="3.682202644s" totalImagesPullingTime="1.52406436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:40.680512923 +0000 UTC m=+509.502614497" watchObservedRunningTime="2026-06-09 00:07:40.682202644 +0000 UTC m=+509.504304208" Jun 09 00:07:40.789232 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.789206 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:40.863711 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.863686 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm7r4\" (UniqueName: \"kubernetes.io/projected/3aea16de-01e4-4615-b83a-a14f50cee3c7-kube-api-access-fm7r4\") pod \"3aea16de-01e4-4615-b83a-a14f50cee3c7\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " Jun 09 00:07:40.863836 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.863715 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-util\") pod \"3aea16de-01e4-4615-b83a-a14f50cee3c7\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " Jun 09 00:07:40.863836 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.863783 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-bundle\") pod \"3aea16de-01e4-4615-b83a-a14f50cee3c7\" (UID: \"3aea16de-01e4-4615-b83a-a14f50cee3c7\") " Jun 09 00:07:40.864635 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.864591 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-bundle" (OuterVolumeSpecName: "bundle") pod "3aea16de-01e4-4615-b83a-a14f50cee3c7" (UID: "3aea16de-01e4-4615-b83a-a14f50cee3c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:07:40.865718 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.865688 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aea16de-01e4-4615-b83a-a14f50cee3c7-kube-api-access-fm7r4" (OuterVolumeSpecName: "kube-api-access-fm7r4") pod "3aea16de-01e4-4615-b83a-a14f50cee3c7" (UID: "3aea16de-01e4-4615-b83a-a14f50cee3c7"). InnerVolumeSpecName "kube-api-access-fm7r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:07:40.869002 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.868978 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-util" (OuterVolumeSpecName: "util") pod "3aea16de-01e4-4615-b83a-a14f50cee3c7" (UID: "3aea16de-01e4-4615-b83a-a14f50cee3c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:07:40.964411 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.964359 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:07:40.964411 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.964381 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm7r4\" (UniqueName: \"kubernetes.io/projected/3aea16de-01e4-4615-b83a-a14f50cee3c7-kube-api-access-fm7r4\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:07:40.964411 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:40.964390 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aea16de-01e4-4615-b83a-a14f50cee3c7-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:07:41.667304 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:41.667276 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" Jun 09 00:07:41.667304 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:41.667286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqx22" event={"ID":"3aea16de-01e4-4615-b83a-a14f50cee3c7","Type":"ContainerDied","Data":"06968c9f107a117308e7533a6637831a394eb970b8eb994e71e62c0ea49cf47f"} Jun 09 00:07:41.667698 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:41.667327 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06968c9f107a117308e7533a6637831a394eb970b8eb994e71e62c0ea49cf47f" Jun 09 00:07:50.330046 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.330009 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22"] Jun 09 00:07:50.330437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.330343 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerName="extract" Jun 09 00:07:50.330437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.330354 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerName="extract" Jun 09 00:07:50.330437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.330366 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerName="pull" Jun 09 00:07:50.330437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.330372 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerName="pull" Jun 09 00:07:50.330437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.330388 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerName="util" Jun 09 00:07:50.330437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.330394 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerName="util" Jun 09 00:07:50.330644 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.330443 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aea16de-01e4-4615-b83a-a14f50cee3c7" containerName="extract" Jun 09 00:07:50.337375 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.337353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.339996 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.339975 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:07:50.340162 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.340143 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzvpb\"" Jun 09 00:07:50.341110 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.341091 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:07:50.343861 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.343837 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22"] Jun 09 00:07:50.445551 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.445520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.445735 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.445585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.445735 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.445635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrdt5\" (UniqueName: \"kubernetes.io/projected/0232788d-fb81-4802-8d9c-d1847cd12f8e-kube-api-access-rrdt5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.546152 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.546116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.546290 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.546158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrdt5\" (UniqueName: \"kubernetes.io/projected/0232788d-fb81-4802-8d9c-d1847cd12f8e-kube-api-access-rrdt5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.546290 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.546231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.546545 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.546529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.546600 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.546582 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.557162 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.557129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrdt5\" (UniqueName: \"kubernetes.io/projected/0232788d-fb81-4802-8d9c-d1847cd12f8e-kube-api-access-rrdt5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.648221 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.648129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:50.782380 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:50.782356 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22"] Jun 09 00:07:50.784402 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:07:50.784374 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0232788d_fb81_4802_8d9c_d1847cd12f8e.slice/crio-f231daae00b3218e86b291946574f14da383c16263a101b84d9e2f288f8ef220 WatchSource:0}: Error finding container f231daae00b3218e86b291946574f14da383c16263a101b84d9e2f288f8ef220: Status 404 returned error can't find the container with id f231daae00b3218e86b291946574f14da383c16263a101b84d9e2f288f8ef220 Jun 09 00:07:51.670082 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:51.670048 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f4484c748-w5s6d" Jun 09 00:07:51.719574 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:51.719543 2562 generic.go:356] "Generic (PLEG): container finished" podID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerID="d72843ccd3bf432e411e5f2a90e4d59911319d07e0215d5ff3698c2159abb852" exitCode=0 Jun 09 00:07:51.719761 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:51.719649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" event={"ID":"0232788d-fb81-4802-8d9c-d1847cd12f8e","Type":"ContainerDied","Data":"d72843ccd3bf432e411e5f2a90e4d59911319d07e0215d5ff3698c2159abb852"} Jun 09 00:07:51.719761 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:51.719703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" event={"ID":"0232788d-fb81-4802-8d9c-d1847cd12f8e","Type":"ContainerStarted","Data":"f231daae00b3218e86b291946574f14da383c16263a101b84d9e2f288f8ef220"} Jun 09 00:07:52.732717 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:52.732678 2562 generic.go:356] "Generic (PLEG): container finished" podID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerID="62739f79aa8c106740091a93bbd3c07141a8fe44bcf5d43ad4d88fa69322a899" exitCode=0 Jun 09 00:07:52.733127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:52.732765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" event={"ID":"0232788d-fb81-4802-8d9c-d1847cd12f8e","Type":"ContainerDied","Data":"62739f79aa8c106740091a93bbd3c07141a8fe44bcf5d43ad4d88fa69322a899"} Jun 09 00:07:53.740216 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:53.740182 2562 generic.go:356] "Generic (PLEG): container finished" podID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerID="3b08817cd87bf43bf2e18fe0977de7f6214d1a154a1a52e592060e9e92972418" exitCode=0 Jun 09 00:07:53.740658 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:53.740265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" event={"ID":"0232788d-fb81-4802-8d9c-d1847cd12f8e","Type":"ContainerDied","Data":"3b08817cd87bf43bf2e18fe0977de7f6214d1a154a1a52e592060e9e92972418"} Jun 09 00:07:54.875434 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:54.875410 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:54.984939 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:54.984899 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-util\") pod \"0232788d-fb81-4802-8d9c-d1847cd12f8e\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " Jun 09 00:07:54.985106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:54.984949 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-bundle\") pod \"0232788d-fb81-4802-8d9c-d1847cd12f8e\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " Jun 09 00:07:54.985106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:54.985083 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrdt5\" (UniqueName: \"kubernetes.io/projected/0232788d-fb81-4802-8d9c-d1847cd12f8e-kube-api-access-rrdt5\") pod \"0232788d-fb81-4802-8d9c-d1847cd12f8e\" (UID: \"0232788d-fb81-4802-8d9c-d1847cd12f8e\") " Jun 09 00:07:54.986190 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:54.986159 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-bundle" (OuterVolumeSpecName: "bundle") pod "0232788d-fb81-4802-8d9c-d1847cd12f8e" (UID: "0232788d-fb81-4802-8d9c-d1847cd12f8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:07:54.987809 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:54.987773 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0232788d-fb81-4802-8d9c-d1847cd12f8e-kube-api-access-rrdt5" (OuterVolumeSpecName: "kube-api-access-rrdt5") pod "0232788d-fb81-4802-8d9c-d1847cd12f8e" (UID: "0232788d-fb81-4802-8d9c-d1847cd12f8e"). InnerVolumeSpecName "kube-api-access-rrdt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:07:54.993430 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:54.993399 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-util" (OuterVolumeSpecName: "util") pod "0232788d-fb81-4802-8d9c-d1847cd12f8e" (UID: "0232788d-fb81-4802-8d9c-d1847cd12f8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:07:55.086324 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:55.086239 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrdt5\" (UniqueName: \"kubernetes.io/projected/0232788d-fb81-4802-8d9c-d1847cd12f8e-kube-api-access-rrdt5\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:07:55.086324 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:55.086272 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:07:55.086324 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:55.086281 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0232788d-fb81-4802-8d9c-d1847cd12f8e-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:07:55.750870 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:55.750845 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" Jun 09 00:07:55.751027 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:55.750844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahdc22" event={"ID":"0232788d-fb81-4802-8d9c-d1847cd12f8e","Type":"ContainerDied","Data":"f231daae00b3218e86b291946574f14da383c16263a101b84d9e2f288f8ef220"} Jun 09 00:07:55.751027 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:07:55.750965 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f231daae00b3218e86b291946574f14da383c16263a101b84d9e2f288f8ef220" Jun 09 00:08:41.481331 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.481294 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-655b6bd488-tnzmg"] Jun 09 00:08:41.481908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.481784 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerName="pull" Jun 09 00:08:41.481908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.481804 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerName="pull" Jun 09 00:08:41.481908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.481818 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerName="util" Jun 09 00:08:41.481908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.481827 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerName="util" Jun 09 00:08:41.481908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.481865 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerName="extract" Jun 09 00:08:41.481908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.481874 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerName="extract" Jun 09 00:08:41.482211 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.481960 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0232788d-fb81-4802-8d9c-d1847cd12f8e" containerName="extract" Jun 09 00:08:41.484148 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.484127 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.496124 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.496102 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655b6bd488-tnzmg"] Jun 09 00:08:41.573527 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.573503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2632fd0-947e-4829-bbca-17af3355f40f-console-oauth-config\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.573644 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.573538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-console-config\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.573644 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.573555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-trusted-ca-bundle\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.573644 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.573585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2632fd0-947e-4829-bbca-17af3355f40f-console-serving-cert\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.573644 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.573639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-oauth-serving-cert\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.573785 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.573669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8cbq\" (UniqueName: \"kubernetes.io/projected/d2632fd0-947e-4829-bbca-17af3355f40f-kube-api-access-s8cbq\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.573785 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.573689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-service-ca\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.674217 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.674193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-service-ca\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.674303 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.674248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2632fd0-947e-4829-bbca-17af3355f40f-console-oauth-config\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.674426 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.674410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-console-config\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.674484 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.674437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-trusted-ca-bundle\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.674484 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.674470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2632fd0-947e-4829-bbca-17af3355f40f-console-serving-cert\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.674706 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.674495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-oauth-serving-cert\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.674706 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.674539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8cbq\" (UniqueName: \"kubernetes.io/projected/d2632fd0-947e-4829-bbca-17af3355f40f-kube-api-access-s8cbq\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.675035 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.675014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-service-ca\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.675113 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.675098 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-console-config\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.675259 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.675226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-oauth-serving-cert\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.675478 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.675460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2632fd0-947e-4829-bbca-17af3355f40f-trusted-ca-bundle\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.676821 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.676793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2632fd0-947e-4829-bbca-17af3355f40f-console-serving-cert\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.676908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.676869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2632fd0-947e-4829-bbca-17af3355f40f-console-oauth-config\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.682691 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.682674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8cbq\" (UniqueName: \"kubernetes.io/projected/d2632fd0-947e-4829-bbca-17af3355f40f-kube-api-access-s8cbq\") pod \"console-655b6bd488-tnzmg\" (UID: \"d2632fd0-947e-4829-bbca-17af3355f40f\") " pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.792954 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.792933 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:41.931803 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.931779 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655b6bd488-tnzmg"] Jun 09 00:08:41.933305 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:08:41.933280 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2632fd0_947e_4829_bbca_17af3355f40f.slice/crio-b59ced54feedbd7e825a0a95e5a08271ed1022f8b9e668ccef363e65fa8eac88 WatchSource:0}: Error finding container b59ced54feedbd7e825a0a95e5a08271ed1022f8b9e668ccef363e65fa8eac88: Status 404 returned error can't find the container with id b59ced54feedbd7e825a0a95e5a08271ed1022f8b9e668ccef363e65fa8eac88 Jun 09 00:08:41.980886 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:41.980859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655b6bd488-tnzmg" event={"ID":"d2632fd0-947e-4829-bbca-17af3355f40f","Type":"ContainerStarted","Data":"b59ced54feedbd7e825a0a95e5a08271ed1022f8b9e668ccef363e65fa8eac88"} Jun 09 00:08:42.988424 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:42.988385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655b6bd488-tnzmg" event={"ID":"d2632fd0-947e-4829-bbca-17af3355f40f","Type":"ContainerStarted","Data":"e792f6f58ffe711c0778d2aebc12597a7b374af1dc0ea521fe7e0070972e9964"} Jun 09 00:08:43.005536 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:43.005487 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-655b6bd488-tnzmg" podStartSLOduration=2.005472559 podStartE2EDuration="2.005472559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:08:43.004465054 +0000 UTC m=+571.826566618" watchObservedRunningTime="2026-06-09 00:08:43.005472559 +0000 UTC m=+571.827574177" Jun 09 00:08:45.350965 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.350933 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2"] Jun 09 00:08:45.353491 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.353476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.356166 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.356148 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 00:08:45.356166 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.356155 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 00:08:45.357243 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.357226 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8thkf\"" Jun 09 00:08:45.362455 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.362433 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2"] Jun 09 00:08:45.506033 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.506002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.506153 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.506083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m4d5\" (UniqueName: \"kubernetes.io/projected/68847a67-9863-4472-bf6c-fec99be89be1-kube-api-access-2m4d5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.506153 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.506140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.607468 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.607403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.607587 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.607467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4d5\" (UniqueName: \"kubernetes.io/projected/68847a67-9863-4472-bf6c-fec99be89be1-kube-api-access-2m4d5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.607587 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.607508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.607872 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.607850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.607935 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.607901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.616050 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.616030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m4d5\" (UniqueName: \"kubernetes.io/projected/68847a67-9863-4472-bf6c-fec99be89be1-kube-api-access-2m4d5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.664037 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.663995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:45.791705 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.791679 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2"] Jun 09 00:08:45.793154 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:08:45.793116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68847a67_9863_4472_bf6c_fec99be89be1.slice/crio-2833dfc37a8251d88b20e295502651e74922d5c276b2691fb53cdf47ab9539b1 WatchSource:0}: Error finding container 2833dfc37a8251d88b20e295502651e74922d5c276b2691fb53cdf47ab9539b1: Status 404 returned error can't find the container with id 2833dfc37a8251d88b20e295502651e74922d5c276b2691fb53cdf47ab9539b1 Jun 09 00:08:45.950190 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.950160 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d"] Jun 09 00:08:45.952531 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.952516 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:45.961343 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:45.961317 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d"] Jun 09 00:08:46.005064 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.005035 2562 generic.go:356] "Generic (PLEG): container finished" podID="68847a67-9863-4472-bf6c-fec99be89be1" containerID="b31fabb742f2c0862112706e7157cafe5e5cbec3ef7526f5ed94f460d072c166" exitCode=0 Jun 09 00:08:46.005177 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.005117 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" event={"ID":"68847a67-9863-4472-bf6c-fec99be89be1","Type":"ContainerDied","Data":"b31fabb742f2c0862112706e7157cafe5e5cbec3ef7526f5ed94f460d072c166"} Jun 09 00:08:46.005177 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.005163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" event={"ID":"68847a67-9863-4472-bf6c-fec99be89be1","Type":"ContainerStarted","Data":"2833dfc37a8251d88b20e295502651e74922d5c276b2691fb53cdf47ab9539b1"} Jun 09 00:08:46.112721 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.112688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n698b\" (UniqueName: \"kubernetes.io/projected/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-kube-api-access-n698b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.112841 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.112732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.112841 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.112759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.213447 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.213383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n698b\" (UniqueName: \"kubernetes.io/projected/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-kube-api-access-n698b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.213447 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.213421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.213585 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.213448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.213776 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.213759 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.213815 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.213796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.221010 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.220985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n698b\" (UniqueName: \"kubernetes.io/projected/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-kube-api-access-n698b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.261948 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.261927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:46.392398 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.392361 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d"] Jun 09 00:08:46.393031 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:08:46.393008 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4e3c5a_4f3d_4a77_b947_c8cee2edf2fd.slice/crio-a86580c7d4cc23caedf66ae0928e7cfb575511dc75785c80675a6dec08e22ffc WatchSource:0}: Error finding container a86580c7d4cc23caedf66ae0928e7cfb575511dc75785c80675a6dec08e22ffc: Status 404 returned error can't find the container with id a86580c7d4cc23caedf66ae0928e7cfb575511dc75785c80675a6dec08e22ffc Jun 09 00:08:46.553150 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.553119 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9"] Jun 09 00:08:46.555770 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.555756 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.564834 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.564813 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9"] Jun 09 00:08:46.719701 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.719668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.719961 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.719748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.719961 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.719807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl7lz\" (UniqueName: \"kubernetes.io/projected/66661064-99ea-47aa-a91e-34dea8dfe4bf-kube-api-access-vl7lz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.820961 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.820931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.821057 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.820977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl7lz\" (UniqueName: \"kubernetes.io/projected/66661064-99ea-47aa-a91e-34dea8dfe4bf-kube-api-access-vl7lz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.821057 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.821048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.821328 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.821305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.821383 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.821355 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.828567 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.828544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl7lz\" (UniqueName: \"kubernetes.io/projected/66661064-99ea-47aa-a91e-34dea8dfe4bf-kube-api-access-vl7lz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.865491 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.865471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:46.955019 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.954994 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4"] Jun 09 00:08:46.957965 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.957949 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:46.967445 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.967275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4"] Jun 09 00:08:46.997330 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:46.997309 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9"] Jun 09 00:08:46.998434 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:08:46.998413 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66661064_99ea_47aa_a91e_34dea8dfe4bf.slice/crio-d1717a580c4c4a70f0c331ad60041e02e7d2487578779fba1e3ca6e818ca2411 WatchSource:0}: Error finding container d1717a580c4c4a70f0c331ad60041e02e7d2487578779fba1e3ca6e818ca2411: Status 404 returned error can't find the container with id d1717a580c4c4a70f0c331ad60041e02e7d2487578779fba1e3ca6e818ca2411 Jun 09 00:08:47.012004 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.011983 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" event={"ID":"66661064-99ea-47aa-a91e-34dea8dfe4bf","Type":"ContainerStarted","Data":"d1717a580c4c4a70f0c331ad60041e02e7d2487578779fba1e3ca6e818ca2411"} Jun 09 00:08:47.013454 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.013432 2562 generic.go:356] "Generic (PLEG): container finished" podID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerID="1f9e34c8091e7bec24ad5155ec21546ccc5977cd2f8c96ef045e403ed746a271" exitCode=0 Jun 09 00:08:47.013553 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.013510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" event={"ID":"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd","Type":"ContainerDied","Data":"1f9e34c8091e7bec24ad5155ec21546ccc5977cd2f8c96ef045e403ed746a271"} Jun 09 00:08:47.013635 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.013554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" event={"ID":"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd","Type":"ContainerStarted","Data":"a86580c7d4cc23caedf66ae0928e7cfb575511dc75785c80675a6dec08e22ffc"} Jun 09 00:08:47.015572 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.015547 2562 generic.go:356] "Generic (PLEG): container finished" podID="68847a67-9863-4472-bf6c-fec99be89be1" containerID="432ed791549a5078e6d0176010041a480fff417396ea12fad46050b4aa06d042" exitCode=0 Jun 09 00:08:47.015684 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.015601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" event={"ID":"68847a67-9863-4472-bf6c-fec99be89be1","Type":"ContainerDied","Data":"432ed791549a5078e6d0176010041a480fff417396ea12fad46050b4aa06d042"} Jun 09 00:08:47.124052 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.124019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.124219 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.124191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrpcc\" (UniqueName: \"kubernetes.io/projected/20ec7104-f97f-4242-8011-f462023045cb-kube-api-access-vrpcc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.124322 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.124303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.225476 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.225444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.225653 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.225487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.225653 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.225556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrpcc\" (UniqueName: \"kubernetes.io/projected/20ec7104-f97f-4242-8011-f462023045cb-kube-api-access-vrpcc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.225900 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.225877 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.225963 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.225940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.233873 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.233854 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrpcc\" (UniqueName: \"kubernetes.io/projected/20ec7104-f97f-4242-8011-f462023045cb-kube-api-access-vrpcc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.270326 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.270273 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:47.395739 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:47.395715 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4"] Jun 09 00:08:47.397311 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:08:47.397279 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ec7104_f97f_4242_8011_f462023045cb.slice/crio-95ea13b5699d89a5daea8b32639eb0e5c3a0fe9c6609cbd8394158d43410648f WatchSource:0}: Error finding container 95ea13b5699d89a5daea8b32639eb0e5c3a0fe9c6609cbd8394158d43410648f: Status 404 returned error can't find the container with id 95ea13b5699d89a5daea8b32639eb0e5c3a0fe9c6609cbd8394158d43410648f Jun 09 00:08:48.022618 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.022578 2562 generic.go:356] "Generic (PLEG): container finished" podID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerID="995bb7ceeca3cd1748c0f2a39ee2d88f2aa20391d2b53382ab0e22d724e6e732" exitCode=0 Jun 09 00:08:48.022730 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.022654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" event={"ID":"66661064-99ea-47aa-a91e-34dea8dfe4bf","Type":"ContainerDied","Data":"995bb7ceeca3cd1748c0f2a39ee2d88f2aa20391d2b53382ab0e22d724e6e732"} Jun 09 00:08:48.024472 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.024451 2562 generic.go:356] "Generic (PLEG): container finished" podID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerID="7748f1f2dcc599826ef266d2214313f8cb3364896a112c9555f04b7d57c9cd67" exitCode=0 Jun 09 00:08:48.024576 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.024531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" event={"ID":"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd","Type":"ContainerDied","Data":"7748f1f2dcc599826ef266d2214313f8cb3364896a112c9555f04b7d57c9cd67"} Jun 09 00:08:48.026168 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.026073 2562 generic.go:356] "Generic (PLEG): container finished" podID="20ec7104-f97f-4242-8011-f462023045cb" containerID="c89423ec037550d3153d9a7ccd8a914c881fc4dfcb9388fdf66473e48da964e1" exitCode=0 Jun 09 00:08:48.026237 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.026190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" event={"ID":"20ec7104-f97f-4242-8011-f462023045cb","Type":"ContainerDied","Data":"c89423ec037550d3153d9a7ccd8a914c881fc4dfcb9388fdf66473e48da964e1"} Jun 09 00:08:48.026237 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.026231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" event={"ID":"20ec7104-f97f-4242-8011-f462023045cb","Type":"ContainerStarted","Data":"95ea13b5699d89a5daea8b32639eb0e5c3a0fe9c6609cbd8394158d43410648f"} Jun 09 00:08:48.028530 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.028508 2562 generic.go:356] "Generic (PLEG): container finished" podID="68847a67-9863-4472-bf6c-fec99be89be1" containerID="e0a3046c49a805c313454856922d92c3cd441751721f5fa715e9458997fb4d1d" exitCode=0 Jun 09 00:08:48.028593 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:48.028546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" event={"ID":"68847a67-9863-4472-bf6c-fec99be89be1","Type":"ContainerDied","Data":"e0a3046c49a805c313454856922d92c3cd441751721f5fa715e9458997fb4d1d"} Jun 09 00:08:49.036256 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.036223 2562 generic.go:356] "Generic (PLEG): container finished" podID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerID="f97b10c9754d88ce90b74c3a3178f9325e1461b6e2953effad7155f2dc5475dd" exitCode=0 Jun 09 00:08:49.036662 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.036308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" event={"ID":"66661064-99ea-47aa-a91e-34dea8dfe4bf","Type":"ContainerDied","Data":"f97b10c9754d88ce90b74c3a3178f9325e1461b6e2953effad7155f2dc5475dd"} Jun 09 00:08:49.038719 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.038698 2562 generic.go:356] "Generic (PLEG): container finished" podID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerID="ac0fe9e8bee2928e60685197cd85f372f0d874a7da6fde50636f9c4cf111faf0" exitCode=0 Jun 09 00:08:49.038818 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.038724 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" event={"ID":"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd","Type":"ContainerDied","Data":"ac0fe9e8bee2928e60685197cd85f372f0d874a7da6fde50636f9c4cf111faf0"} Jun 09 00:08:49.040791 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.040756 2562 generic.go:356] "Generic (PLEG): container finished" podID="20ec7104-f97f-4242-8011-f462023045cb" containerID="5d7804f9d59caecd9d4fd9807b1dafa7d67f9ab46a98db15637e33cdad36e637" exitCode=0 Jun 09 00:08:49.040859 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.040779 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" event={"ID":"20ec7104-f97f-4242-8011-f462023045cb","Type":"ContainerDied","Data":"5d7804f9d59caecd9d4fd9807b1dafa7d67f9ab46a98db15637e33cdad36e637"} Jun 09 00:08:49.174910 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.174883 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:49.342772 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.342717 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-bundle\") pod \"68847a67-9863-4472-bf6c-fec99be89be1\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " Jun 09 00:08:49.342874 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.342796 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-util\") pod \"68847a67-9863-4472-bf6c-fec99be89be1\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " Jun 09 00:08:49.342874 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.342828 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m4d5\" (UniqueName: \"kubernetes.io/projected/68847a67-9863-4472-bf6c-fec99be89be1-kube-api-access-2m4d5\") pod \"68847a67-9863-4472-bf6c-fec99be89be1\" (UID: \"68847a67-9863-4472-bf6c-fec99be89be1\") " Jun 09 00:08:49.343360 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.343333 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-bundle" (OuterVolumeSpecName: "bundle") pod "68847a67-9863-4472-bf6c-fec99be89be1" (UID: "68847a67-9863-4472-bf6c-fec99be89be1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:49.344996 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.344972 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68847a67-9863-4472-bf6c-fec99be89be1-kube-api-access-2m4d5" (OuterVolumeSpecName: "kube-api-access-2m4d5") pod "68847a67-9863-4472-bf6c-fec99be89be1" (UID: "68847a67-9863-4472-bf6c-fec99be89be1"). InnerVolumeSpecName "kube-api-access-2m4d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:08:49.347816 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.347796 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-util" (OuterVolumeSpecName: "util") pod "68847a67-9863-4472-bf6c-fec99be89be1" (UID: "68847a67-9863-4472-bf6c-fec99be89be1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:49.444300 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.444274 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:49.444300 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.444295 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68847a67-9863-4472-bf6c-fec99be89be1-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:49.444421 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:49.444304 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m4d5\" (UniqueName: \"kubernetes.io/projected/68847a67-9863-4472-bf6c-fec99be89be1-kube-api-access-2m4d5\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:50.047789 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.047758 2562 generic.go:356] "Generic (PLEG): container finished" podID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerID="a77d58820f90194ef809c0092f3e97eba219f5b3d27948c4a779d511a0f150c0" exitCode=0 Jun 09 00:08:50.048148 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.047839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" event={"ID":"66661064-99ea-47aa-a91e-34dea8dfe4bf","Type":"ContainerDied","Data":"a77d58820f90194ef809c0092f3e97eba219f5b3d27948c4a779d511a0f150c0"} Jun 09 00:08:50.049747 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.049725 2562 generic.go:356] "Generic (PLEG): container finished" podID="20ec7104-f97f-4242-8011-f462023045cb" containerID="3f0efdb7b0ce07237839ad231c346875c035a08c3f76e41dcde21d7e0ba06460" exitCode=0 Jun 09 00:08:50.049827 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.049810 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" event={"ID":"20ec7104-f97f-4242-8011-f462023045cb","Type":"ContainerDied","Data":"3f0efdb7b0ce07237839ad231c346875c035a08c3f76e41dcde21d7e0ba06460"} Jun 09 00:08:50.051462 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.051446 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" Jun 09 00:08:50.051601 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.051485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2" event={"ID":"68847a67-9863-4472-bf6c-fec99be89be1","Type":"ContainerDied","Data":"2833dfc37a8251d88b20e295502651e74922d5c276b2691fb53cdf47ab9539b1"} Jun 09 00:08:50.051601 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.051516 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2833dfc37a8251d88b20e295502651e74922d5c276b2691fb53cdf47ab9539b1" Jun 09 00:08:50.181627 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.181587 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:50.350858 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.350784 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n698b\" (UniqueName: \"kubernetes.io/projected/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-kube-api-access-n698b\") pod \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " Jun 09 00:08:50.350988 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.350919 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-bundle\") pod \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " Jun 09 00:08:50.350988 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.350948 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-util\") pod \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\" (UID: \"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd\") " Jun 09 00:08:50.351448 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.351422 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-bundle" (OuterVolumeSpecName: "bundle") pod "9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" (UID: "9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:50.353047 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.353022 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-kube-api-access-n698b" (OuterVolumeSpecName: "kube-api-access-n698b") pod "9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" (UID: "9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd"). InnerVolumeSpecName "kube-api-access-n698b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:08:50.356131 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.356109 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-util" (OuterVolumeSpecName: "util") pod "9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" (UID: "9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:50.452316 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.452296 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n698b\" (UniqueName: \"kubernetes.io/projected/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-kube-api-access-n698b\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:50.452316 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.452317 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:50.452435 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:50.452326 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:51.059856 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.059825 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" Jun 09 00:08:51.059856 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.059847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d" event={"ID":"9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd","Type":"ContainerDied","Data":"a86580c7d4cc23caedf66ae0928e7cfb575511dc75785c80675a6dec08e22ffc"} Jun 09 00:08:51.060268 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.059898 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a86580c7d4cc23caedf66ae0928e7cfb575511dc75785c80675a6dec08e22ffc" Jun 09 00:08:51.216644 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.216597 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:51.219868 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.219848 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:51.358937 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.358869 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-util\") pod \"20ec7104-f97f-4242-8011-f462023045cb\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " Jun 09 00:08:51.358937 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.358929 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-bundle\") pod \"20ec7104-f97f-4242-8011-f462023045cb\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " Jun 09 00:08:51.359108 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.358954 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-bundle\") pod \"66661064-99ea-47aa-a91e-34dea8dfe4bf\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " Jun 09 00:08:51.359108 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.359001 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrpcc\" (UniqueName: \"kubernetes.io/projected/20ec7104-f97f-4242-8011-f462023045cb-kube-api-access-vrpcc\") pod \"20ec7104-f97f-4242-8011-f462023045cb\" (UID: \"20ec7104-f97f-4242-8011-f462023045cb\") " Jun 09 00:08:51.359108 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.359028 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl7lz\" (UniqueName: \"kubernetes.io/projected/66661064-99ea-47aa-a91e-34dea8dfe4bf-kube-api-access-vl7lz\") pod \"66661064-99ea-47aa-a91e-34dea8dfe4bf\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " Jun 09 00:08:51.359108 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.359085 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-util\") pod \"66661064-99ea-47aa-a91e-34dea8dfe4bf\" (UID: \"66661064-99ea-47aa-a91e-34dea8dfe4bf\") " Jun 09 00:08:51.359576 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.359544 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-bundle" (OuterVolumeSpecName: "bundle") pod "66661064-99ea-47aa-a91e-34dea8dfe4bf" (UID: "66661064-99ea-47aa-a91e-34dea8dfe4bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:51.359881 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.359849 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-bundle" (OuterVolumeSpecName: "bundle") pod "20ec7104-f97f-4242-8011-f462023045cb" (UID: "20ec7104-f97f-4242-8011-f462023045cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:51.361229 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.361201 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ec7104-f97f-4242-8011-f462023045cb-kube-api-access-vrpcc" (OuterVolumeSpecName: "kube-api-access-vrpcc") pod "20ec7104-f97f-4242-8011-f462023045cb" (UID: "20ec7104-f97f-4242-8011-f462023045cb"). InnerVolumeSpecName "kube-api-access-vrpcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:08:51.361331 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.361302 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66661064-99ea-47aa-a91e-34dea8dfe4bf-kube-api-access-vl7lz" (OuterVolumeSpecName: "kube-api-access-vl7lz") pod "66661064-99ea-47aa-a91e-34dea8dfe4bf" (UID: "66661064-99ea-47aa-a91e-34dea8dfe4bf"). InnerVolumeSpecName "kube-api-access-vl7lz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:08:51.364566 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.364536 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-util" (OuterVolumeSpecName: "util") pod "20ec7104-f97f-4242-8011-f462023045cb" (UID: "20ec7104-f97f-4242-8011-f462023045cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:51.365083 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.365063 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-util" (OuterVolumeSpecName: "util") pod "66661064-99ea-47aa-a91e-34dea8dfe4bf" (UID: "66661064-99ea-47aa-a91e-34dea8dfe4bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:08:51.459918 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.459877 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrpcc\" (UniqueName: \"kubernetes.io/projected/20ec7104-f97f-4242-8011-f462023045cb-kube-api-access-vrpcc\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:51.459918 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.459915 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl7lz\" (UniqueName: \"kubernetes.io/projected/66661064-99ea-47aa-a91e-34dea8dfe4bf-kube-api-access-vl7lz\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:51.459918 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.459926 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:51.460106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.459936 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:51.460106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.459944 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20ec7104-f97f-4242-8011-f462023045cb-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:51.460106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.459952 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66661064-99ea-47aa-a91e-34dea8dfe4bf-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:08:51.793345 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.793317 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:51.793466 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.793370 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:51.797772 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:51.797750 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:52.067267 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:52.067243 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" Jun 09 00:08:52.067267 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:52.067250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4" event={"ID":"20ec7104-f97f-4242-8011-f462023045cb","Type":"ContainerDied","Data":"95ea13b5699d89a5daea8b32639eb0e5c3a0fe9c6609cbd8394158d43410648f"} Jun 09 00:08:52.067709 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:52.067290 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95ea13b5699d89a5daea8b32639eb0e5c3a0fe9c6609cbd8394158d43410648f" Jun 09 00:08:52.069654 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:52.069633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" event={"ID":"66661064-99ea-47aa-a91e-34dea8dfe4bf","Type":"ContainerDied","Data":"d1717a580c4c4a70f0c331ad60041e02e7d2487578779fba1e3ca6e818ca2411"} Jun 09 00:08:52.069783 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:52.069675 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1717a580c4c4a70f0c331ad60041e02e7d2487578779fba1e3ca6e818ca2411" Jun 09 00:08:52.069783 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:52.069677 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9" Jun 09 00:08:52.074771 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:52.074742 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-655b6bd488-tnzmg" Jun 09 00:08:52.120423 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:08:52.120378 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd6c94469-c5mbx"] Jun 09 00:09:11.628085 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:11.628055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 09 00:09:11.628529 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:11.628275 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 09 00:09:17.140089 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.140048 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dd6c94469-c5mbx" podUID="5b12611c-4222-4f5f-ae20-58644e7f5207" containerName="console" containerID="cri-o://51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0" gracePeriod=15 Jun 09 00:09:17.390142 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.390080 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:09:17.467891 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.467866 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-console-config\") pod \"5b12611c-4222-4f5f-ae20-58644e7f5207\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " Jun 09 00:09:17.468105 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.467902 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-trusted-ca-bundle\") pod \"5b12611c-4222-4f5f-ae20-58644e7f5207\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " Jun 09 00:09:17.468105 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.467938 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-serving-cert\") pod \"5b12611c-4222-4f5f-ae20-58644e7f5207\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " Jun 09 00:09:17.468105 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.467967 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-oauth-serving-cert\") pod \"5b12611c-4222-4f5f-ae20-58644e7f5207\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " Jun 09 00:09:17.468105 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.467999 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-oauth-config\") pod \"5b12611c-4222-4f5f-ae20-58644e7f5207\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " Jun 09 00:09:17.468105 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.468032 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-service-ca\") pod \"5b12611c-4222-4f5f-ae20-58644e7f5207\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " Jun 09 00:09:17.468105 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.468058 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt6dd\" (UniqueName: \"kubernetes.io/projected/5b12611c-4222-4f5f-ae20-58644e7f5207-kube-api-access-xt6dd\") pod \"5b12611c-4222-4f5f-ae20-58644e7f5207\" (UID: \"5b12611c-4222-4f5f-ae20-58644e7f5207\") " Jun 09 00:09:17.468411 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.468388 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-console-config" (OuterVolumeSpecName: "console-config") pod "5b12611c-4222-4f5f-ae20-58644e7f5207" (UID: "5b12611c-4222-4f5f-ae20-58644e7f5207"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:09:17.468478 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.468452 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5b12611c-4222-4f5f-ae20-58644e7f5207" (UID: "5b12611c-4222-4f5f-ae20-58644e7f5207"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:09:17.468529 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.468482 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5b12611c-4222-4f5f-ae20-58644e7f5207" (UID: "5b12611c-4222-4f5f-ae20-58644e7f5207"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:09:17.468566 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.468522 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-service-ca" (OuterVolumeSpecName: "service-ca") pod "5b12611c-4222-4f5f-ae20-58644e7f5207" (UID: "5b12611c-4222-4f5f-ae20-58644e7f5207"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:09:17.470283 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.470255 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b12611c-4222-4f5f-ae20-58644e7f5207-kube-api-access-xt6dd" (OuterVolumeSpecName: "kube-api-access-xt6dd") pod "5b12611c-4222-4f5f-ae20-58644e7f5207" (UID: "5b12611c-4222-4f5f-ae20-58644e7f5207"). InnerVolumeSpecName "kube-api-access-xt6dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:09:17.470519 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.470482 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5b12611c-4222-4f5f-ae20-58644e7f5207" (UID: "5b12611c-4222-4f5f-ae20-58644e7f5207"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:09:17.470519 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.470503 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5b12611c-4222-4f5f-ae20-58644e7f5207" (UID: "5b12611c-4222-4f5f-ae20-58644e7f5207"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:09:17.569003 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.568977 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:09:17.569003 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.569000 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-oauth-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:09:17.569003 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.569009 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b12611c-4222-4f5f-ae20-58644e7f5207-console-oauth-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:09:17.569192 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.569018 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-service-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:09:17.569192 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.569027 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt6dd\" (UniqueName: \"kubernetes.io/projected/5b12611c-4222-4f5f-ae20-58644e7f5207-kube-api-access-xt6dd\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:09:17.569192 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.569036 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-console-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:09:17.569192 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:17.569045 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b12611c-4222-4f5f-ae20-58644e7f5207-trusted-ca-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:09:18.204367 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.204330 2562 generic.go:356] "Generic (PLEG): container finished" podID="5b12611c-4222-4f5f-ae20-58644e7f5207" containerID="51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0" exitCode=0 Jun 09 00:09:18.204788 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.204380 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd6c94469-c5mbx" Jun 09 00:09:18.204788 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.204381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd6c94469-c5mbx" event={"ID":"5b12611c-4222-4f5f-ae20-58644e7f5207","Type":"ContainerDied","Data":"51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0"} Jun 09 00:09:18.204788 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.204508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd6c94469-c5mbx" event={"ID":"5b12611c-4222-4f5f-ae20-58644e7f5207","Type":"ContainerDied","Data":"863d49eaa4a377b0f6ee0af5e4e0111f6d06d410b4d44a820a3fe89a4e333f82"} Jun 09 00:09:18.204788 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.204542 2562 scope.go:117] "RemoveContainer" containerID="51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0" Jun 09 00:09:18.213692 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.213676 2562 scope.go:117] "RemoveContainer" containerID="51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0" Jun 09 00:09:18.213937 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:09:18.213917 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0\": container with ID starting with 51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0 not found: ID does not exist" containerID="51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0" Jun 09 00:09:18.213978 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.213947 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0"} err="failed to get container status \"51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0\": rpc error: code = NotFound desc = could not find container \"51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0\": container with ID starting with 51cda69c809f91581bde9a0bfbf9850558adfe96366edefb82216d56c3c49be0 not found: ID does not exist" Jun 09 00:09:18.223625 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.223581 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd6c94469-c5mbx"] Jun 09 00:09:18.225788 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:18.225770 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dd6c94469-c5mbx"] Jun 09 00:09:19.643310 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:09:19.643280 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b12611c-4222-4f5f-ae20-58644e7f5207" path="/var/lib/kubelet/pods/5b12611c-4222-4f5f-ae20-58644e7f5207/volumes" Jun 09 00:10:06.406932 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.406893 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407228 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68847a67-9863-4472-bf6c-fec99be89be1" containerName="pull" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407239 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="68847a67-9863-4472-bf6c-fec99be89be1" containerName="pull" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407261 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ec7104-f97f-4242-8011-f462023045cb" containerName="extract" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407268 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ec7104-f97f-4242-8011-f462023045cb" containerName="extract" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407278 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerName="util" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407283 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerName="util" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407290 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68847a67-9863-4472-bf6c-fec99be89be1" containerName="util" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407296 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="68847a67-9863-4472-bf6c-fec99be89be1" containerName="util" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407305 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerName="pull" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407310 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerName="pull" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407322 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ec7104-f97f-4242-8011-f462023045cb" containerName="util" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407327 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ec7104-f97f-4242-8011-f462023045cb" containerName="util" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407334 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b12611c-4222-4f5f-ae20-58644e7f5207" containerName="console" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407341 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b12611c-4222-4f5f-ae20-58644e7f5207" containerName="console" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407346 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerName="util" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407351 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerName="util" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407361 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerName="extract" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407369 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerName="extract" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407377 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerName="pull" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407382 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerName="pull" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407388 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68847a67-9863-4472-bf6c-fec99be89be1" containerName="extract" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407393 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="68847a67-9863-4472-bf6c-fec99be89be1" containerName="extract" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407399 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ec7104-f97f-4242-8011-f462023045cb" containerName="pull" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407404 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ec7104-f97f-4242-8011-f462023045cb" containerName="pull" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407410 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerName="extract" Jun 09 00:10:06.407414 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407415 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerName="extract" Jun 09 00:10:06.408196 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407465 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="68847a67-9863-4472-bf6c-fec99be89be1" containerName="extract" Jun 09 00:10:06.408196 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407475 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ec7104-f97f-4242-8011-f462023045cb" containerName="extract" Jun 09 00:10:06.408196 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407482 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="66661064-99ea-47aa-a91e-34dea8dfe4bf" containerName="extract" Jun 09 00:10:06.408196 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407489 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd" containerName="extract" Jun 09 00:10:06.408196 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.407494 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b12611c-4222-4f5f-ae20-58644e7f5207" containerName="console" Jun 09 00:10:06.410684 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.410659 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:06.413088 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.413066 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 00:10:06.413194 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.413073 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 00:10:06.414125 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.414093 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 00:10:06.414230 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.414125 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8thkf\"" Jun 09 00:10:06.417943 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.417917 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:10:06.440511 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.440473 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:10:06.480898 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.480858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpb4g\" (UniqueName: \"kubernetes.io/projected/cccb77ff-63e5-4fc1-ac25-edf07de171d9-kube-api-access-xpb4g\") pod \"limitador-limitador-54d6d988d5-4dqvz\" (UID: \"cccb77ff-63e5-4fc1-ac25-edf07de171d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:06.481073 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.480918 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cccb77ff-63e5-4fc1-ac25-edf07de171d9-config-file\") pod \"limitador-limitador-54d6d988d5-4dqvz\" (UID: \"cccb77ff-63e5-4fc1-ac25-edf07de171d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:06.581772 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.581729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cccb77ff-63e5-4fc1-ac25-edf07de171d9-config-file\") pod \"limitador-limitador-54d6d988d5-4dqvz\" (UID: \"cccb77ff-63e5-4fc1-ac25-edf07de171d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:06.581966 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.581809 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpb4g\" (UniqueName: \"kubernetes.io/projected/cccb77ff-63e5-4fc1-ac25-edf07de171d9-kube-api-access-xpb4g\") pod \"limitador-limitador-54d6d988d5-4dqvz\" (UID: \"cccb77ff-63e5-4fc1-ac25-edf07de171d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:06.582377 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.582358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cccb77ff-63e5-4fc1-ac25-edf07de171d9-config-file\") pod \"limitador-limitador-54d6d988d5-4dqvz\" (UID: \"cccb77ff-63e5-4fc1-ac25-edf07de171d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:06.589499 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.589461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpb4g\" (UniqueName: \"kubernetes.io/projected/cccb77ff-63e5-4fc1-ac25-edf07de171d9-kube-api-access-xpb4g\") pod \"limitador-limitador-54d6d988d5-4dqvz\" (UID: \"cccb77ff-63e5-4fc1-ac25-edf07de171d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:06.716271 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.716166 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-scdtl"] Jun 09 00:10:06.719775 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.719748 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-scdtl" Jun 09 00:10:06.722156 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.722138 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ng7ch\"" Jun 09 00:10:06.724134 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.724119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:06.728979 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.728946 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-scdtl"] Jun 09 00:10:06.784459 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.784421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgsm5\" (UniqueName: \"kubernetes.io/projected/6000b996-101a-4166-99c8-a3b7d10ee4d1-kube-api-access-pgsm5\") pod \"authorino-58cd955675-scdtl\" (UID: \"6000b996-101a-4166-99c8-a3b7d10ee4d1\") " pod="kuadrant-system/authorino-58cd955675-scdtl" Jun 09 00:10:06.864778 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.864751 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:10:06.866424 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:10:06.866394 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcccb77ff_63e5_4fc1_ac25_edf07de171d9.slice/crio-f6375ae9a87634ee25e724662e72207f59c0c05189c612c723a200a945fcd965 WatchSource:0}: Error finding container f6375ae9a87634ee25e724662e72207f59c0c05189c612c723a200a945fcd965: Status 404 returned error can't find the container with id f6375ae9a87634ee25e724662e72207f59c0c05189c612c723a200a945fcd965 Jun 09 00:10:06.885254 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.885225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgsm5\" (UniqueName: \"kubernetes.io/projected/6000b996-101a-4166-99c8-a3b7d10ee4d1-kube-api-access-pgsm5\") pod \"authorino-58cd955675-scdtl\" (UID: \"6000b996-101a-4166-99c8-a3b7d10ee4d1\") " pod="kuadrant-system/authorino-58cd955675-scdtl" Jun 09 00:10:06.894455 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:06.894431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgsm5\" (UniqueName: \"kubernetes.io/projected/6000b996-101a-4166-99c8-a3b7d10ee4d1-kube-api-access-pgsm5\") pod \"authorino-58cd955675-scdtl\" (UID: \"6000b996-101a-4166-99c8-a3b7d10ee4d1\") " pod="kuadrant-system/authorino-58cd955675-scdtl" Jun 09 00:10:07.031156 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:07.031113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-scdtl" Jun 09 00:10:07.172336 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:07.172304 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-scdtl"] Jun 09 00:10:07.173419 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:10:07.173392 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6000b996_101a_4166_99c8_a3b7d10ee4d1.slice/crio-ac87a25db403290af4abf9a01715b2ea82261bfa8d4704d3b11f6a29cd12a29a WatchSource:0}: Error finding container ac87a25db403290af4abf9a01715b2ea82261bfa8d4704d3b11f6a29cd12a29a: Status 404 returned error can't find the container with id ac87a25db403290af4abf9a01715b2ea82261bfa8d4704d3b11f6a29cd12a29a Jun 09 00:10:07.472069 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:07.471969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-scdtl" event={"ID":"6000b996-101a-4166-99c8-a3b7d10ee4d1","Type":"ContainerStarted","Data":"ac87a25db403290af4abf9a01715b2ea82261bfa8d4704d3b11f6a29cd12a29a"} Jun 09 00:10:07.474357 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:07.474302 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" event={"ID":"cccb77ff-63e5-4fc1-ac25-edf07de171d9","Type":"ContainerStarted","Data":"f6375ae9a87634ee25e724662e72207f59c0c05189c612c723a200a945fcd965"} Jun 09 00:10:11.504390 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:11.504353 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-scdtl" event={"ID":"6000b996-101a-4166-99c8-a3b7d10ee4d1","Type":"ContainerStarted","Data":"68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c"} Jun 09 00:10:11.505916 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:11.505892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" event={"ID":"cccb77ff-63e5-4fc1-ac25-edf07de171d9","Type":"ContainerStarted","Data":"7925f0e3a36a849f3924ef708f57ef22a462f5224004c4306a6b14ae5d5088ed"} Jun 09 00:10:11.506044 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:11.505978 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:11.518691 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:11.518648 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-scdtl" podStartSLOduration=1.5178862610000001 podStartE2EDuration="5.518630709s" totalImagesPullingTime="4.000744448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:10:11.517488541 +0000 UTC m=+660.339590118" watchObservedRunningTime="2026-06-09 00:10:11.518630709 +0000 UTC m=+660.340732271" Jun 09 00:10:11.533441 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:11.533397 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" podStartSLOduration=1.239456902 podStartE2EDuration="5.533381016s" totalImagesPullingTime="4.293924114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:10:11.532324011 +0000 UTC m=+660.354425589" watchObservedRunningTime="2026-06-09 00:10:11.533381016 +0000 UTC m=+660.355482578" Jun 09 00:10:12.286261 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:12.286208 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-scdtl"] Jun 09 00:10:13.515903 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:13.515861 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-scdtl" podUID="6000b996-101a-4166-99c8-a3b7d10ee4d1" containerName="authorino" containerID="cri-o://68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c" gracePeriod=30 Jun 09 00:10:13.770842 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:13.770782 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-scdtl" Jun 09 00:10:13.859676 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:13.859641 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgsm5\" (UniqueName: \"kubernetes.io/projected/6000b996-101a-4166-99c8-a3b7d10ee4d1-kube-api-access-pgsm5\") pod \"6000b996-101a-4166-99c8-a3b7d10ee4d1\" (UID: \"6000b996-101a-4166-99c8-a3b7d10ee4d1\") " Jun 09 00:10:13.861731 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:13.861699 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6000b996-101a-4166-99c8-a3b7d10ee4d1-kube-api-access-pgsm5" (OuterVolumeSpecName: "kube-api-access-pgsm5") pod "6000b996-101a-4166-99c8-a3b7d10ee4d1" (UID: "6000b996-101a-4166-99c8-a3b7d10ee4d1"). InnerVolumeSpecName "kube-api-access-pgsm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:10:13.961059 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:13.961022 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgsm5\" (UniqueName: \"kubernetes.io/projected/6000b996-101a-4166-99c8-a3b7d10ee4d1-kube-api-access-pgsm5\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:10:14.521939 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.521903 2562 generic.go:356] "Generic (PLEG): container finished" podID="6000b996-101a-4166-99c8-a3b7d10ee4d1" containerID="68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c" exitCode=0 Jun 09 00:10:14.522380 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.521948 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-scdtl" Jun 09 00:10:14.522380 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.521993 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-scdtl" event={"ID":"6000b996-101a-4166-99c8-a3b7d10ee4d1","Type":"ContainerDied","Data":"68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c"} Jun 09 00:10:14.522380 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.522031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-scdtl" event={"ID":"6000b996-101a-4166-99c8-a3b7d10ee4d1","Type":"ContainerDied","Data":"ac87a25db403290af4abf9a01715b2ea82261bfa8d4704d3b11f6a29cd12a29a"} Jun 09 00:10:14.522380 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.522048 2562 scope.go:117] "RemoveContainer" containerID="68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c" Jun 09 00:10:14.530907 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.530889 2562 scope.go:117] "RemoveContainer" containerID="68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c" Jun 09 00:10:14.531166 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:10:14.531149 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c\": container with ID starting with 68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c not found: ID does not exist" containerID="68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c" Jun 09 00:10:14.531241 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.531171 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c"} err="failed to get container status \"68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c\": rpc error: code = NotFound desc = could not find container \"68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c\": container with ID starting with 68cee7b16426ab8548b6ad301def0b3383c403fe93d2e8cbd37a351698132b1c not found: ID does not exist" Jun 09 00:10:14.542698 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.542677 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-scdtl"] Jun 09 00:10:14.544799 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:14.544780 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-scdtl"] Jun 09 00:10:15.643527 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:15.643492 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6000b996-101a-4166-99c8-a3b7d10ee4d1" path="/var/lib/kubelet/pods/6000b996-101a-4166-99c8-a3b7d10ee4d1/volumes" Jun 09 00:10:22.512312 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:22.512276 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4dqvz" Jun 09 00:10:36.714298 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.714260 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79"] Jun 09 00:10:36.714711 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.714596 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6000b996-101a-4166-99c8-a3b7d10ee4d1" containerName="authorino" Jun 09 00:10:36.714711 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.714620 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6000b996-101a-4166-99c8-a3b7d10ee4d1" containerName="authorino" Jun 09 00:10:36.714711 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.714684 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6000b996-101a-4166-99c8-a3b7d10ee4d1" containerName="authorino" Jun 09 00:10:36.718045 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.718027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.720509 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.720483 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:10:36.720647 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.720560 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzvpb\"" Jun 09 00:10:36.720647 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.720564 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:10:36.725938 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.725920 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79"] Jun 09 00:10:36.847210 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.847187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.847329 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.847227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxsbh\" (UniqueName: \"kubernetes.io/projected/5b4bb162-19ec-4471-99ca-7e20f80435c4-kube-api-access-wxsbh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.847329 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.847323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.948439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.948416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.948548 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.948448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxsbh\" (UniqueName: \"kubernetes.io/projected/5b4bb162-19ec-4471-99ca-7e20f80435c4-kube-api-access-wxsbh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.948548 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.948493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.948837 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.948817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.948897 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.948856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:36.960082 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:36.960058 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxsbh\" (UniqueName: \"kubernetes.io/projected/5b4bb162-19ec-4471-99ca-7e20f80435c4-kube-api-access-wxsbh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:37.027830 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:37.027805 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:37.157434 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:37.157409 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79"] Jun 09 00:10:37.158558 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:10:37.158531 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4bb162_19ec_4471_99ca_7e20f80435c4.slice/crio-d3743c17590c5617e4a08389e65933c8fa7f5fbea9df2a1ba96edc3473c46266 WatchSource:0}: Error finding container d3743c17590c5617e4a08389e65933c8fa7f5fbea9df2a1ba96edc3473c46266: Status 404 returned error can't find the container with id d3743c17590c5617e4a08389e65933c8fa7f5fbea9df2a1ba96edc3473c46266 Jun 09 00:10:37.647462 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:37.647432 2562 generic.go:356] "Generic (PLEG): container finished" podID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerID="51977618f6d9d63b497a50233db4a908fc8941371783b47f7db839ffdaaba5d6" exitCode=0 Jun 09 00:10:37.647672 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:37.647515 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" event={"ID":"5b4bb162-19ec-4471-99ca-7e20f80435c4","Type":"ContainerDied","Data":"51977618f6d9d63b497a50233db4a908fc8941371783b47f7db839ffdaaba5d6"} Jun 09 00:10:37.647672 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:37.647556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" event={"ID":"5b4bb162-19ec-4471-99ca-7e20f80435c4","Type":"ContainerStarted","Data":"d3743c17590c5617e4a08389e65933c8fa7f5fbea9df2a1ba96edc3473c46266"} Jun 09 00:10:38.655401 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:38.655329 2562 generic.go:356] "Generic (PLEG): container finished" podID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerID="36115fcf68a4688ea80a345c7cee6a4e59d692a5077dc8a16a6300b148c42364" exitCode=0 Jun 09 00:10:38.655732 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:38.655416 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" event={"ID":"5b4bb162-19ec-4471-99ca-7e20f80435c4","Type":"ContainerDied","Data":"36115fcf68a4688ea80a345c7cee6a4e59d692a5077dc8a16a6300b148c42364"} Jun 09 00:10:39.663746 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:39.663713 2562 generic.go:356] "Generic (PLEG): container finished" podID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerID="09622cd0fdb5187fc93d86ca93f60a65cf8ee7882ea80f232641d86c3bb15fa6" exitCode=0 Jun 09 00:10:39.664118 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:39.663801 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" event={"ID":"5b4bb162-19ec-4471-99ca-7e20f80435c4","Type":"ContainerDied","Data":"09622cd0fdb5187fc93d86ca93f60a65cf8ee7882ea80f232641d86c3bb15fa6"} Jun 09 00:10:40.807327 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.807307 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:40.883647 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.883599 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxsbh\" (UniqueName: \"kubernetes.io/projected/5b4bb162-19ec-4471-99ca-7e20f80435c4-kube-api-access-wxsbh\") pod \"5b4bb162-19ec-4471-99ca-7e20f80435c4\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " Jun 09 00:10:40.883767 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.883706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-util\") pod \"5b4bb162-19ec-4471-99ca-7e20f80435c4\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " Jun 09 00:10:40.883767 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.883730 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-bundle\") pod \"5b4bb162-19ec-4471-99ca-7e20f80435c4\" (UID: \"5b4bb162-19ec-4471-99ca-7e20f80435c4\") " Jun 09 00:10:40.884215 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.884193 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-bundle" (OuterVolumeSpecName: "bundle") pod "5b4bb162-19ec-4471-99ca-7e20f80435c4" (UID: "5b4bb162-19ec-4471-99ca-7e20f80435c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:10:40.885595 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.885570 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b4bb162-19ec-4471-99ca-7e20f80435c4-kube-api-access-wxsbh" (OuterVolumeSpecName: "kube-api-access-wxsbh") pod "5b4bb162-19ec-4471-99ca-7e20f80435c4" (UID: "5b4bb162-19ec-4471-99ca-7e20f80435c4"). InnerVolumeSpecName "kube-api-access-wxsbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:10:40.889769 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.889750 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-util" (OuterVolumeSpecName: "util") pod "5b4bb162-19ec-4471-99ca-7e20f80435c4" (UID: "5b4bb162-19ec-4471-99ca-7e20f80435c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:10:40.984362 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.984339 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-util\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:10:40.984449 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.984362 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b4bb162-19ec-4471-99ca-7e20f80435c4-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:10:40.984449 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:40.984377 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxsbh\" (UniqueName: \"kubernetes.io/projected/5b4bb162-19ec-4471-99ca-7e20f80435c4-kube-api-access-wxsbh\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:10:41.680535 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:41.680510 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" Jun 09 00:10:41.680535 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:41.680516 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qqj79" event={"ID":"5b4bb162-19ec-4471-99ca-7e20f80435c4","Type":"ContainerDied","Data":"d3743c17590c5617e4a08389e65933c8fa7f5fbea9df2a1ba96edc3473c46266"} Jun 09 00:10:41.680731 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:10:41.680557 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3743c17590c5617e4a08389e65933c8fa7f5fbea9df2a1ba96edc3473c46266" Jun 09 00:11:33.962223 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.962190 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smmnh"] Jun 09 00:11:33.962702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.962518 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerName="util" Jun 09 00:11:33.962702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.962529 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerName="util" Jun 09 00:11:33.962702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.962538 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerName="pull" Jun 09 00:11:33.962702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.962544 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerName="pull" Jun 09 00:11:33.962702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.962566 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerName="extract" Jun 09 00:11:33.962702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.962572 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerName="extract" Jun 09 00:11:33.962702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.962647 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b4bb162-19ec-4471-99ca-7e20f80435c4" containerName="extract" Jun 09 00:11:33.964669 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.964652 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smmnh" Jun 09 00:11:33.967143 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.967120 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ng7ch\"" Jun 09 00:11:33.972347 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:33.972317 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smmnh"] Jun 09 00:11:34.025211 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.025169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4b4b\" (UniqueName: \"kubernetes.io/projected/23409f44-6981-4a80-8988-1a58731840d7-kube-api-access-x4b4b\") pod \"authorino-5d4b67c446-smmnh\" (UID: \"23409f44-6981-4a80-8988-1a58731840d7\") " pod="kuadrant-system/authorino-5d4b67c446-smmnh" Jun 09 00:11:34.125981 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.125937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4b4b\" (UniqueName: \"kubernetes.io/projected/23409f44-6981-4a80-8988-1a58731840d7-kube-api-access-x4b4b\") pod \"authorino-5d4b67c446-smmnh\" (UID: \"23409f44-6981-4a80-8988-1a58731840d7\") " pod="kuadrant-system/authorino-5d4b67c446-smmnh" Jun 09 00:11:34.133612 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.133588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4b4b\" (UniqueName: \"kubernetes.io/projected/23409f44-6981-4a80-8988-1a58731840d7-kube-api-access-x4b4b\") pod \"authorino-5d4b67c446-smmnh\" (UID: \"23409f44-6981-4a80-8988-1a58731840d7\") " pod="kuadrant-system/authorino-5d4b67c446-smmnh" Jun 09 00:11:34.194251 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.194209 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smmnh"] Jun 09 00:11:34.194503 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.194490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smmnh" Jun 09 00:11:34.214074 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.214002 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68c47fbbcf-qvqkp"] Jun 09 00:11:34.217171 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.217146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c47fbbcf-qvqkp" Jun 09 00:11:34.223033 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.223006 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68c47fbbcf-qvqkp"] Jun 09 00:11:34.226374 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.226351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5djhn\" (UniqueName: \"kubernetes.io/projected/aa4ecf13-8e32-4230-974e-62e5efcebc6c-kube-api-access-5djhn\") pod \"authorino-68c47fbbcf-qvqkp\" (UID: \"aa4ecf13-8e32-4230-974e-62e5efcebc6c\") " pod="kuadrant-system/authorino-68c47fbbcf-qvqkp" Jun 09 00:11:34.283862 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.283663 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68c47fbbcf-qvqkp"] Jun 09 00:11:34.284030 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:11:34.284002 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5djhn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-68c47fbbcf-qvqkp" podUID="aa4ecf13-8e32-4230-974e-62e5efcebc6c" Jun 09 00:11:34.304918 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.304885 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-657d9b47f5-sbfjq"] Jun 09 00:11:34.307805 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.307782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:11:34.310282 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.310260 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 00:11:34.316988 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.316958 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-657d9b47f5-sbfjq"] Jun 09 00:11:34.327453 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.327421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-tls-cert\") pod \"authorino-657d9b47f5-sbfjq\" (UID: \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\") " pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:11:34.327638 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.327617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5djhn\" (UniqueName: \"kubernetes.io/projected/aa4ecf13-8e32-4230-974e-62e5efcebc6c-kube-api-access-5djhn\") pod \"authorino-68c47fbbcf-qvqkp\" (UID: \"aa4ecf13-8e32-4230-974e-62e5efcebc6c\") " pod="kuadrant-system/authorino-68c47fbbcf-qvqkp" Jun 09 00:11:34.327711 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.327652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77wp7\" (UniqueName: \"kubernetes.io/projected/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-kube-api-access-77wp7\") pod \"authorino-657d9b47f5-sbfjq\" (UID: \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\") " pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:11:34.336410 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.336382 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smmnh"] Jun 09 00:11:34.337803 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.337772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5djhn\" (UniqueName: \"kubernetes.io/projected/aa4ecf13-8e32-4230-974e-62e5efcebc6c-kube-api-access-5djhn\") pod \"authorino-68c47fbbcf-qvqkp\" (UID: \"aa4ecf13-8e32-4230-974e-62e5efcebc6c\") " pod="kuadrant-system/authorino-68c47fbbcf-qvqkp" Jun 09 00:11:34.338328 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:11:34.338298 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23409f44_6981_4a80_8988_1a58731840d7.slice/crio-4c654ca08369d44662aff1d80ad6e367599bf2a5995d4b75fbcdf8d91082498a WatchSource:0}: Error finding container 4c654ca08369d44662aff1d80ad6e367599bf2a5995d4b75fbcdf8d91082498a: Status 404 returned error can't find the container with id 4c654ca08369d44662aff1d80ad6e367599bf2a5995d4b75fbcdf8d91082498a Jun 09 00:11:34.339688 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.339668 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:11:34.428757 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.428721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-tls-cert\") pod \"authorino-657d9b47f5-sbfjq\" (UID: \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\") " pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:11:34.428953 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.428777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77wp7\" (UniqueName: \"kubernetes.io/projected/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-kube-api-access-77wp7\") pod \"authorino-657d9b47f5-sbfjq\" (UID: \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\") " pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:11:34.431206 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.431185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-tls-cert\") pod \"authorino-657d9b47f5-sbfjq\" (UID: \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\") " pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:11:34.435860 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.435840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77wp7\" (UniqueName: \"kubernetes.io/projected/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-kube-api-access-77wp7\") pod \"authorino-657d9b47f5-sbfjq\" (UID: \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\") " pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:11:34.619218 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.619185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:11:34.748339 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.748312 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-657d9b47f5-sbfjq"] Jun 09 00:11:34.759896 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:11:34.759854 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1f52cf_8ac9_4678_8fa1_2b2ee4d7b2fb.slice/crio-d3efbfde8160f8ce51cb44df48aa6360cb7a18e717af95b3913e3f72a3fc4f90 WatchSource:0}: Error finding container d3efbfde8160f8ce51cb44df48aa6360cb7a18e717af95b3913e3f72a3fc4f90: Status 404 returned error can't find the container with id d3efbfde8160f8ce51cb44df48aa6360cb7a18e717af95b3913e3f72a3fc4f90 Jun 09 00:11:34.978732 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.978640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-smmnh" event={"ID":"23409f44-6981-4a80-8988-1a58731840d7","Type":"ContainerStarted","Data":"16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee"} Jun 09 00:11:34.978732 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.978693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-smmnh" event={"ID":"23409f44-6981-4a80-8988-1a58731840d7","Type":"ContainerStarted","Data":"4c654ca08369d44662aff1d80ad6e367599bf2a5995d4b75fbcdf8d91082498a"} Jun 09 00:11:34.979233 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.978735 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-smmnh" podUID="23409f44-6981-4a80-8988-1a58731840d7" containerName="authorino" containerID="cri-o://16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee" gracePeriod=30 Jun 09 00:11:34.980198 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.980163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" event={"ID":"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb","Type":"ContainerStarted","Data":"d3efbfde8160f8ce51cb44df48aa6360cb7a18e717af95b3913e3f72a3fc4f90"} Jun 09 00:11:34.980361 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.980182 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c47fbbcf-qvqkp" Jun 09 00:11:34.987438 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.987415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c47fbbcf-qvqkp" Jun 09 00:11:34.993760 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:34.993707 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-smmnh" podStartSLOduration=1.605833359 podStartE2EDuration="1.993689458s" totalImagesPullingTime="387.856099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:11:34.99293986 +0000 UTC m=+743.815041436" watchObservedRunningTime="2026-06-09 00:11:34.993689458 +0000 UTC m=+743.815791023" Jun 09 00:11:35.133006 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.132961 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5djhn\" (UniqueName: \"kubernetes.io/projected/aa4ecf13-8e32-4230-974e-62e5efcebc6c-kube-api-access-5djhn\") pod \"aa4ecf13-8e32-4230-974e-62e5efcebc6c\" (UID: \"aa4ecf13-8e32-4230-974e-62e5efcebc6c\") " Jun 09 00:11:35.135040 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.134999 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4ecf13-8e32-4230-974e-62e5efcebc6c-kube-api-access-5djhn" (OuterVolumeSpecName: "kube-api-access-5djhn") pod "aa4ecf13-8e32-4230-974e-62e5efcebc6c" (UID: "aa4ecf13-8e32-4230-974e-62e5efcebc6c"). InnerVolumeSpecName "kube-api-access-5djhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:11:35.220037 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.220007 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smmnh" Jun 09 00:11:35.234320 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.234298 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4b4b\" (UniqueName: \"kubernetes.io/projected/23409f44-6981-4a80-8988-1a58731840d7-kube-api-access-x4b4b\") pod \"23409f44-6981-4a80-8988-1a58731840d7\" (UID: \"23409f44-6981-4a80-8988-1a58731840d7\") " Jun 09 00:11:35.234497 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.234485 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5djhn\" (UniqueName: \"kubernetes.io/projected/aa4ecf13-8e32-4230-974e-62e5efcebc6c-kube-api-access-5djhn\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:11:35.237111 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.237075 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23409f44-6981-4a80-8988-1a58731840d7-kube-api-access-x4b4b" (OuterVolumeSpecName: "kube-api-access-x4b4b") pod "23409f44-6981-4a80-8988-1a58731840d7" (UID: "23409f44-6981-4a80-8988-1a58731840d7"). InnerVolumeSpecName "kube-api-access-x4b4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:11:35.335941 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.335905 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4b4b\" (UniqueName: \"kubernetes.io/projected/23409f44-6981-4a80-8988-1a58731840d7-kube-api-access-x4b4b\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:11:35.986747 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.986713 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" event={"ID":"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb","Type":"ContainerStarted","Data":"607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca"} Jun 09 00:11:35.987960 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.987932 2562 generic.go:356] "Generic (PLEG): container finished" podID="23409f44-6981-4a80-8988-1a58731840d7" containerID="16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee" exitCode=0 Jun 09 00:11:35.988091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.987972 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smmnh" Jun 09 00:11:35.988091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.987991 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c47fbbcf-qvqkp" Jun 09 00:11:35.988091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.988012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-smmnh" event={"ID":"23409f44-6981-4a80-8988-1a58731840d7","Type":"ContainerDied","Data":"16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee"} Jun 09 00:11:35.988091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.988043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-smmnh" event={"ID":"23409f44-6981-4a80-8988-1a58731840d7","Type":"ContainerDied","Data":"4c654ca08369d44662aff1d80ad6e367599bf2a5995d4b75fbcdf8d91082498a"} Jun 09 00:11:35.988091 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.988062 2562 scope.go:117] "RemoveContainer" containerID="16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee" Jun 09 00:11:35.997341 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.997322 2562 scope.go:117] "RemoveContainer" containerID="16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee" Jun 09 00:11:35.997649 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:11:35.997632 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee\": container with ID starting with 16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee not found: ID does not exist" containerID="16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee" Jun 09 00:11:35.997728 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:35.997664 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee"} err="failed to get container status \"16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee\": rpc error: code = NotFound desc = could not find container \"16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee\": container with ID starting with 16347a55896c030223b9a2617327049adb64e91a0b4d66206e221bfe53de50ee not found: ID does not exist" Jun 09 00:11:36.001426 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:36.001375 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" podStartSLOduration=1.592928035 podStartE2EDuration="2.001360195s" totalImagesPullingTime="408.43216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:11:36.000363744 +0000 UTC m=+744.822465329" watchObservedRunningTime="2026-06-09 00:11:36.001360195 +0000 UTC m=+744.823461757" Jun 09 00:11:36.027127 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:36.027095 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68c47fbbcf-qvqkp"] Jun 09 00:11:36.036250 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:36.036217 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68c47fbbcf-qvqkp"] Jun 09 00:11:36.063441 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:36.063407 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smmnh"] Jun 09 00:11:36.070447 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:36.070414 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smmnh"] Jun 09 00:11:37.646034 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:37.645991 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23409f44-6981-4a80-8988-1a58731840d7" path="/var/lib/kubelet/pods/23409f44-6981-4a80-8988-1a58731840d7/volumes" Jun 09 00:11:37.646584 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:11:37.646559 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa4ecf13-8e32-4230-974e-62e5efcebc6c" path="/var/lib/kubelet/pods/aa4ecf13-8e32-4230-974e-62e5efcebc6c/volumes" Jun 09 00:12:12.669731 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:12:12.669699 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:13:01.064888 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.064854 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7974684ff9-9hb9q"] Jun 09 00:13:01.065285 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.065222 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23409f44-6981-4a80-8988-1a58731840d7" containerName="authorino" Jun 09 00:13:01.065285 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.065232 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="23409f44-6981-4a80-8988-1a58731840d7" containerName="authorino" Jun 09 00:13:01.065285 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.065286 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="23409f44-6981-4a80-8988-1a58731840d7" containerName="authorino" Jun 09 00:13:01.068107 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.068092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.070440 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.070420 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 00:13:01.075402 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.075014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7974684ff9-9hb9q"] Jun 09 00:13:01.121591 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.121566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtwlv\" (UniqueName: \"kubernetes.io/projected/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-kube-api-access-wtwlv\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.121717 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.121624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-tls-cert\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.121717 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.121667 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-oidc-ca\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.222308 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.222283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-oidc-ca\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.222408 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.222327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtwlv\" (UniqueName: \"kubernetes.io/projected/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-kube-api-access-wtwlv\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.222408 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.222352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-tls-cert\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.223046 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.223028 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-oidc-ca\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.224748 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.224730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-tls-cert\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.229182 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.229165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtwlv\" (UniqueName: \"kubernetes.io/projected/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-kube-api-access-wtwlv\") pod \"authorino-7974684ff9-9hb9q\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.378397 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.378342 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:13:01.517796 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:01.517771 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7974684ff9-9hb9q"] Jun 09 00:13:01.519014 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:13:01.518991 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3797f764_bb90_4f24_a1dd_d54b8e72ed3f.slice/crio-79ab28f203293693350e4ab329c629b4a1083ab41e27fb35b58c135ffc5aba31 WatchSource:0}: Error finding container 79ab28f203293693350e4ab329c629b4a1083ab41e27fb35b58c135ffc5aba31: Status 404 returned error can't find the container with id 79ab28f203293693350e4ab329c629b4a1083ab41e27fb35b58c135ffc5aba31 Jun 09 00:13:02.480007 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.479965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7974684ff9-9hb9q" event={"ID":"3797f764-bb90-4f24-a1dd-d54b8e72ed3f","Type":"ContainerStarted","Data":"3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb"} Jun 09 00:13:02.480007 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.480006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7974684ff9-9hb9q" event={"ID":"3797f764-bb90-4f24-a1dd-d54b8e72ed3f","Type":"ContainerStarted","Data":"79ab28f203293693350e4ab329c629b4a1083ab41e27fb35b58c135ffc5aba31"} Jun 09 00:13:02.499066 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.499009 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7974684ff9-9hb9q" podStartSLOduration=1.090464319 podStartE2EDuration="1.498989161s" totalImagesPullingTime="408.524842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:13:02.495666214 +0000 UTC m=+831.317767778" watchObservedRunningTime="2026-06-09 00:13:02.498989161 +0000 UTC m=+831.321090726" Jun 09 00:13:02.524065 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.523969 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-657d9b47f5-sbfjq"] Jun 09 00:13:02.524240 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.524172 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" podUID="0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb" containerName="authorino" containerID="cri-o://607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca" gracePeriod=30 Jun 09 00:13:02.779121 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.779099 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:13:02.835173 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.835144 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77wp7\" (UniqueName: \"kubernetes.io/projected/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-kube-api-access-77wp7\") pod \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\" (UID: \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\") " Jun 09 00:13:02.835319 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.835273 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-tls-cert\") pod \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\" (UID: \"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb\") " Jun 09 00:13:02.837105 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.837076 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-kube-api-access-77wp7" (OuterVolumeSpecName: "kube-api-access-77wp7") pod "0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb" (UID: "0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb"). InnerVolumeSpecName "kube-api-access-77wp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:13:02.846144 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.846123 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb" (UID: "0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:13:02.936381 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.936354 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-tls-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:13:02.936381 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:02.936378 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77wp7\" (UniqueName: \"kubernetes.io/projected/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb-kube-api-access-77wp7\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:13:03.487000 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.486958 2562 generic.go:356] "Generic (PLEG): container finished" podID="0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb" containerID="607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca" exitCode=0 Jun 09 00:13:03.487439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.487012 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" Jun 09 00:13:03.487439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.487054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" event={"ID":"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb","Type":"ContainerDied","Data":"607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca"} Jun 09 00:13:03.487439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.487104 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-657d9b47f5-sbfjq" event={"ID":"0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb","Type":"ContainerDied","Data":"d3efbfde8160f8ce51cb44df48aa6360cb7a18e717af95b3913e3f72a3fc4f90"} Jun 09 00:13:03.487439 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.487123 2562 scope.go:117] "RemoveContainer" containerID="607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca" Jun 09 00:13:03.498098 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.498080 2562 scope.go:117] "RemoveContainer" containerID="607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca" Jun 09 00:13:03.498396 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:13:03.498375 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca\": container with ID starting with 607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca not found: ID does not exist" containerID="607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca" Jun 09 00:13:03.498442 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.498405 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca"} err="failed to get container status \"607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca\": rpc error: code = NotFound desc = could not find container \"607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca\": container with ID starting with 607732e543f4a2a57b3de52e7b1d801e3451d2c0466f7ed0a0304957371545ca not found: ID does not exist" Jun 09 00:13:03.513167 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.513137 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-657d9b47f5-sbfjq"] Jun 09 00:13:03.516392 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.516370 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-657d9b47f5-sbfjq"] Jun 09 00:13:03.644320 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:03.644295 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb" path="/var/lib/kubelet/pods/0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb/volumes" Jun 09 00:13:15.651172 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:15.651142 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:13:26.445802 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:26.445765 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:13:33.754313 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.754282 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp"] Jun 09 00:13:33.754763 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.754635 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb" containerName="authorino" Jun 09 00:13:33.754763 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.754648 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb" containerName="authorino" Jun 09 00:13:33.754763 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.754728 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1f52cf-8ac9-4678-8fa1-2b2ee4d7b2fb" containerName="authorino" Jun 09 00:13:33.757856 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.757841 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.761187 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.761159 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 00:13:33.761187 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.761175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f7nfn\"" Jun 09 00:13:33.761340 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.761174 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 00:13:33.761340 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.761241 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 00:13:33.765436 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.765413 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp"] Jun 09 00:13:33.877945 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.877915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.877945 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.877945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.878121 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.877971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.878121 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.877992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.878121 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.878069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzqld\" (UniqueName: \"kubernetes.io/projected/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-kube-api-access-tzqld\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.878121 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.878100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978443 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978577 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqld\" (UniqueName: \"kubernetes.io/projected/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-kube-api-access-tzqld\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978577 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978577 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978577 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978577 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978896 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978879 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978946 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.978987 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.978955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.980859 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.980839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.981004 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.980988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:33.985486 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:33.985469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzqld\" (UniqueName: \"kubernetes.io/projected/e88ae309-34d1-4cf7-b61d-2acf9c3ad88b-kube-api-access-tzqld\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp\" (UID: \"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:34.069563 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:34.069510 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:34.197782 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:34.197754 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp"] Jun 09 00:13:34.200148 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:13:34.200118 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88ae309_34d1_4cf7_b61d_2acf9c3ad88b.slice/crio-b6786b86a397e85a1203ed96a4eceef020a3f08c566a1fcb739e75b0f4b347d5 WatchSource:0}: Error finding container b6786b86a397e85a1203ed96a4eceef020a3f08c566a1fcb739e75b0f4b347d5: Status 404 returned error can't find the container with id b6786b86a397e85a1203ed96a4eceef020a3f08c566a1fcb739e75b0f4b347d5 Jun 09 00:13:34.240630 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:34.240580 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:13:34.658149 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:34.658114 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" event={"ID":"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b","Type":"ContainerStarted","Data":"b6786b86a397e85a1203ed96a4eceef020a3f08c566a1fcb739e75b0f4b347d5"} Jun 09 00:13:39.691542 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:39.691501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" event={"ID":"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b","Type":"ContainerStarted","Data":"f75883a4cb985f89b30b5c389b02f018596594f2d8efc2ddf36fc7f6b7855c6e"} Jun 09 00:13:41.704828 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:41.704794 2562 generic.go:356] "Generic (PLEG): container finished" podID="e88ae309-34d1-4cf7-b61d-2acf9c3ad88b" containerID="f75883a4cb985f89b30b5c389b02f018596594f2d8efc2ddf36fc7f6b7855c6e" exitCode=0 Jun 09 00:13:41.705234 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:41.704864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" event={"ID":"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b","Type":"ContainerDied","Data":"f75883a4cb985f89b30b5c389b02f018596594f2d8efc2ddf36fc7f6b7855c6e"} Jun 09 00:13:42.040071 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:42.040031 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:13:43.718545 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:43.718508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" event={"ID":"e88ae309-34d1-4cf7-b61d-2acf9c3ad88b","Type":"ContainerStarted","Data":"0fd3fdbda7096d8f2715d758648050ed0242d52b27834ff9e28b0d635cdd1963"} Jun 09 00:13:43.736517 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:43.736460 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" podStartSLOduration=3.088774733 podStartE2EDuration="10.736444209s" totalImagesPullingTime="6.062670093s" totalInitContainerRuntime="1.584999383s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:13:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:13:43.735569869 +0000 UTC m=+872.557671434" watchObservedRunningTime="2026-06-09 00:13:43.736444209 +0000 UTC m=+872.558545769" Jun 09 00:13:44.070340 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:44.070290 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:44.070555 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:44.070387 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:44.083761 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:44.083726 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:44.736120 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:44.736090 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp" Jun 09 00:13:50.640183 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:13:50.640148 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:14:01.445025 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:01.444987 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:14:11.669582 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:11.669550 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 09 00:14:11.670000 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:11.669639 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 09 00:14:34.104465 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.104432 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5474ccdd54-wctqx"] Jun 09 00:14:34.107616 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.107589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.115960 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.115926 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5474ccdd54-wctqx"] Jun 09 00:14:34.272524 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.272499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-tls-cert\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.272651 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.272537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-oidc-ca\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.272651 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.272620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdnpt\" (UniqueName: \"kubernetes.io/projected/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-kube-api-access-cdnpt\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.373537 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.373477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdnpt\" (UniqueName: \"kubernetes.io/projected/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-kube-api-access-cdnpt\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.373537 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.373517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-tls-cert\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.373702 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.373549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-oidc-ca\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.374158 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.374137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-oidc-ca\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.375848 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.375827 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-tls-cert\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.380838 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.380818 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdnpt\" (UniqueName: \"kubernetes.io/projected/6f3a0c7b-7c05-4b5f-987d-2b48707724f0-kube-api-access-cdnpt\") pod \"authorino-5474ccdd54-wctqx\" (UID: \"6f3a0c7b-7c05-4b5f-987d-2b48707724f0\") " pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.418199 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.418177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5474ccdd54-wctqx" Jun 09 00:14:34.546864 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:34.546836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5474ccdd54-wctqx"] Jun 09 00:14:34.547905 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:14:34.547881 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f3a0c7b_7c05_4b5f_987d_2b48707724f0.slice/crio-22d7263492f74af686a7ccfad48b6f012006eea084953d61e35bc460e7c3ba40 WatchSource:0}: Error finding container 22d7263492f74af686a7ccfad48b6f012006eea084953d61e35bc460e7c3ba40: Status 404 returned error can't find the container with id 22d7263492f74af686a7ccfad48b6f012006eea084953d61e35bc460e7c3ba40 Jun 09 00:14:35.005081 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.005037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5474ccdd54-wctqx" event={"ID":"6f3a0c7b-7c05-4b5f-987d-2b48707724f0","Type":"ContainerStarted","Data":"715f1edae183fc92acf2321ddde5087f0a26dcc247a21f4f8d61b57204fe69fb"} Jun 09 00:14:35.005503 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.005086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5474ccdd54-wctqx" event={"ID":"6f3a0c7b-7c05-4b5f-987d-2b48707724f0","Type":"ContainerStarted","Data":"22d7263492f74af686a7ccfad48b6f012006eea084953d61e35bc460e7c3ba40"} Jun 09 00:14:35.022094 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.022041 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5474ccdd54-wctqx" podStartSLOduration=0.688991685 podStartE2EDuration="1.022024038s" totalImagesPullingTime="333.032353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:14:35.019734289 +0000 UTC m=+923.841835854" watchObservedRunningTime="2026-06-09 00:14:35.022024038 +0000 UTC m=+923.844125601" Jun 09 00:14:35.044158 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.044125 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7974684ff9-9hb9q"] Jun 09 00:14:35.044339 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.044313 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7974684ff9-9hb9q" podUID="3797f764-bb90-4f24-a1dd-d54b8e72ed3f" containerName="authorino" containerID="cri-o://3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb" gracePeriod=30 Jun 09 00:14:35.295677 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.295651 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:14:35.484587 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.484552 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-tls-cert\") pod \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " Jun 09 00:14:35.484778 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.484702 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtwlv\" (UniqueName: \"kubernetes.io/projected/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-kube-api-access-wtwlv\") pod \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " Jun 09 00:14:35.484778 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.484750 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-oidc-ca\") pod \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\" (UID: \"3797f764-bb90-4f24-a1dd-d54b8e72ed3f\") " Jun 09 00:14:35.486709 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.486668 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-kube-api-access-wtwlv" (OuterVolumeSpecName: "kube-api-access-wtwlv") pod "3797f764-bb90-4f24-a1dd-d54b8e72ed3f" (UID: "3797f764-bb90-4f24-a1dd-d54b8e72ed3f"). InnerVolumeSpecName "kube-api-access-wtwlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:14:35.489539 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.489509 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "3797f764-bb90-4f24-a1dd-d54b8e72ed3f" (UID: "3797f764-bb90-4f24-a1dd-d54b8e72ed3f"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:14:35.494882 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.494861 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3797f764-bb90-4f24-a1dd-d54b8e72ed3f" (UID: "3797f764-bb90-4f24-a1dd-d54b8e72ed3f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:14:35.585767 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.585743 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-tls-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:14:35.585767 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.585768 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtwlv\" (UniqueName: \"kubernetes.io/projected/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-kube-api-access-wtwlv\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:14:35.585915 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:35.585779 2562 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3797f764-bb90-4f24-a1dd-d54b8e72ed3f-oidc-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:14:36.011798 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.011764 2562 generic.go:356] "Generic (PLEG): container finished" podID="3797f764-bb90-4f24-a1dd-d54b8e72ed3f" containerID="3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb" exitCode=0 Jun 09 00:14:36.011984 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.011816 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7974684ff9-9hb9q" Jun 09 00:14:36.011984 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.011845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7974684ff9-9hb9q" event={"ID":"3797f764-bb90-4f24-a1dd-d54b8e72ed3f","Type":"ContainerDied","Data":"3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb"} Jun 09 00:14:36.011984 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.011885 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7974684ff9-9hb9q" event={"ID":"3797f764-bb90-4f24-a1dd-d54b8e72ed3f","Type":"ContainerDied","Data":"79ab28f203293693350e4ab329c629b4a1083ab41e27fb35b58c135ffc5aba31"} Jun 09 00:14:36.011984 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.011901 2562 scope.go:117] "RemoveContainer" containerID="3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb" Jun 09 00:14:36.021002 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.020987 2562 scope.go:117] "RemoveContainer" containerID="3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb" Jun 09 00:14:36.021271 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:14:36.021251 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb\": container with ID starting with 3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb not found: ID does not exist" containerID="3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb" Jun 09 00:14:36.021334 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.021277 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb"} err="failed to get container status \"3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb\": rpc error: code = NotFound desc = could not find container \"3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb\": container with ID starting with 3c86b450c8c7990ff2236d4ebc1521a5ef025362a9220dd621cf4f58ef718acb not found: ID does not exist" Jun 09 00:14:36.028503 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.028482 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7974684ff9-9hb9q"] Jun 09 00:14:36.037626 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:36.035130 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7974684ff9-9hb9q"] Jun 09 00:14:37.644206 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:37.644168 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3797f764-bb90-4f24-a1dd-d54b8e72ed3f" path="/var/lib/kubelet/pods/3797f764-bb90-4f24-a1dd-d54b8e72ed3f/volumes" Jun 09 00:14:57.648314 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:14:57.648279 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:15:00.134345 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.134307 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l"] Jun 09 00:15:00.134747 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.134688 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3797f764-bb90-4f24-a1dd-d54b8e72ed3f" containerName="authorino" Jun 09 00:15:00.134747 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.134700 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3797f764-bb90-4f24-a1dd-d54b8e72ed3f" containerName="authorino" Jun 09 00:15:00.134828 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.134760 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3797f764-bb90-4f24-a1dd-d54b8e72ed3f" containerName="authorino" Jun 09 00:15:00.137857 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.137839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" Jun 09 00:15:00.140600 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.140575 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 00:15:00.141819 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.141795 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 00:15:00.142045 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.142030 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-g8db8\"" Jun 09 00:15:00.145499 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.145478 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l"] Jun 09 00:15:00.207116 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.207070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp477\" (UniqueName: \"kubernetes.io/projected/f1f46c31-6e36-4d11-a531-5ad18c2bc167-kube-api-access-wp477\") pod \"maas-api-key-cleanup-29682735-7rj7l\" (UID: \"f1f46c31-6e36-4d11-a531-5ad18c2bc167\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" Jun 09 00:15:00.307955 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.307917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp477\" (UniqueName: \"kubernetes.io/projected/f1f46c31-6e36-4d11-a531-5ad18c2bc167-kube-api-access-wp477\") pod \"maas-api-key-cleanup-29682735-7rj7l\" (UID: \"f1f46c31-6e36-4d11-a531-5ad18c2bc167\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" Jun 09 00:15:00.316883 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.316851 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp477\" (UniqueName: \"kubernetes.io/projected/f1f46c31-6e36-4d11-a531-5ad18c2bc167-kube-api-access-wp477\") pod \"maas-api-key-cleanup-29682735-7rj7l\" (UID: \"f1f46c31-6e36-4d11-a531-5ad18c2bc167\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" Jun 09 00:15:00.450220 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.450114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" Jun 09 00:15:00.587300 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:00.587275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l"] Jun 09 00:15:00.589305 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:15:00.589278 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f46c31_6e36_4d11_a531_5ad18c2bc167.slice/crio-f66b285519f56ab5e31cd57b228ca51757131d98ec40f4c0114ad12e3ded20d7 WatchSource:0}: Error finding container f66b285519f56ab5e31cd57b228ca51757131d98ec40f4c0114ad12e3ded20d7: Status 404 returned error can't find the container with id f66b285519f56ab5e31cd57b228ca51757131d98ec40f4c0114ad12e3ded20d7 Jun 09 00:15:01.136670 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:01.136628 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:15:01.162147 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:01.162111 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" event={"ID":"f1f46c31-6e36-4d11-a531-5ad18c2bc167","Type":"ContainerStarted","Data":"f66b285519f56ab5e31cd57b228ca51757131d98ec40f4c0114ad12e3ded20d7"} Jun 09 00:15:03.175831 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:03.175793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" event={"ID":"f1f46c31-6e36-4d11-a531-5ad18c2bc167","Type":"ContainerStarted","Data":"0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e"} Jun 09 00:15:03.191100 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:03.191038 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" podStartSLOduration=1.083486619 podStartE2EDuration="3.191020968s" totalImagesPullingTime="2.107534349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:15:03.189563162 +0000 UTC m=+952.011664724" watchObservedRunningTime="2026-06-09 00:15:03.191020968 +0000 UTC m=+952.013122531" Jun 09 00:15:08.639982 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:08.639947 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:15:18.136558 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:18.136525 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:15:28.141770 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:28.141688 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:15:38.039818 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:38.039774 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:15:47.538145 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:47.534966 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:15:57.645432 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:15:57.645401 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:16:00.010753 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:00.010713 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l"] Jun 09 00:16:00.011204 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:00.010931 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" podUID="f1f46c31-6e36-4d11-a531-5ad18c2bc167" containerName="cleanup" containerID="cri-o://0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e" gracePeriod=30 Jun 09 00:16:28.634601 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:28.634564 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:16:30.180787 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.180758 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" Jun 09 00:16:30.278157 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.278092 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp477\" (UniqueName: \"kubernetes.io/projected/f1f46c31-6e36-4d11-a531-5ad18c2bc167-kube-api-access-wp477\") pod \"f1f46c31-6e36-4d11-a531-5ad18c2bc167\" (UID: \"f1f46c31-6e36-4d11-a531-5ad18c2bc167\") " Jun 09 00:16:30.280179 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.280156 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f46c31-6e36-4d11-a531-5ad18c2bc167-kube-api-access-wp477" (OuterVolumeSpecName: "kube-api-access-wp477") pod "f1f46c31-6e36-4d11-a531-5ad18c2bc167" (UID: "f1f46c31-6e36-4d11-a531-5ad18c2bc167"). InnerVolumeSpecName "kube-api-access-wp477". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:16:30.378668 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.378642 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp477\" (UniqueName: \"kubernetes.io/projected/f1f46c31-6e36-4d11-a531-5ad18c2bc167-kube-api-access-wp477\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 09 00:16:30.667219 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.667138 2562 generic.go:356] "Generic (PLEG): container finished" podID="f1f46c31-6e36-4d11-a531-5ad18c2bc167" containerID="0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e" exitCode=137 Jun 09 00:16:30.667219 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.667183 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" Jun 09 00:16:30.667219 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.667199 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" event={"ID":"f1f46c31-6e36-4d11-a531-5ad18c2bc167","Type":"ContainerDied","Data":"0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e"} Jun 09 00:16:30.667468 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.667247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l" event={"ID":"f1f46c31-6e36-4d11-a531-5ad18c2bc167","Type":"ContainerDied","Data":"f66b285519f56ab5e31cd57b228ca51757131d98ec40f4c0114ad12e3ded20d7"} Jun 09 00:16:30.667468 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.667287 2562 scope.go:117] "RemoveContainer" containerID="0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e" Jun 09 00:16:30.676552 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.676530 2562 scope.go:117] "RemoveContainer" containerID="0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e" Jun 09 00:16:30.676811 ip-10-0-130-78 kubenswrapper[2562]: E0609 00:16:30.676791 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e\": container with ID starting with 0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e not found: ID does not exist" containerID="0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e" Jun 09 00:16:30.676869 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.676819 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e"} err="failed to get container status \"0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e\": rpc error: code = NotFound desc = could not find container \"0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e\": container with ID starting with 0a245bf11f64e9f232e91bf92ee0021ed1d3889ba5c9087bef86ed8f3711f73e not found: ID does not exist" Jun 09 00:16:30.688189 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.688164 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l"] Jun 09 00:16:30.693457 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:30.693439 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682735-7rj7l"] Jun 09 00:16:31.643339 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:31.643309 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1f46c31-6e36-4d11-a531-5ad18c2bc167" path="/var/lib/kubelet/pods/f1f46c31-6e36-4d11-a531-5ad18c2bc167/volumes" Jun 09 00:16:32.141185 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:32.141143 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:16:38.438315 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:38.438276 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:16:54.938304 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:16:54.938229 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:17:32.544797 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:17:32.544757 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:17:49.631706 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:17:49.631672 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:18:03.646698 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:03.646666 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:18:19.740838 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:19.740807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4dqvz"] Jun 09 00:18:33.338155 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:33.338071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5474ccdd54-wctqx_6f3a0c7b-7c05-4b5f-987d-2b48707724f0/authorino/0.log" Jun 09 00:18:38.785530 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:38.785503 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-dmbv8_0121ebaf-1976-4c01-9785-7b4b7387f472/copy-manifests/0.log" Jun 09 00:18:38.792928 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:38.792892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-dmbv8_0121ebaf-1976-4c01-9785-7b4b7387f472/manager/0.log" Jun 09 00:18:39.701147 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.701115 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9_66661064-99ea-47aa-a91e-34dea8dfe4bf/util/0.log" Jun 09 00:18:39.707564 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.707542 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9_66661064-99ea-47aa-a91e-34dea8dfe4bf/pull/0.log" Jun 09 00:18:39.713356 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.713340 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9_66661064-99ea-47aa-a91e-34dea8dfe4bf/extract/0.log" Jun 09 00:18:39.821269 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.821247 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4_20ec7104-f97f-4242-8011-f462023045cb/util/0.log" Jun 09 00:18:39.828200 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.828178 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4_20ec7104-f97f-4242-8011-f462023045cb/pull/0.log" Jun 09 00:18:39.834440 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.834395 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4_20ec7104-f97f-4242-8011-f462023045cb/extract/0.log" Jun 09 00:18:39.949095 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.949071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2_68847a67-9863-4472-bf6c-fec99be89be1/util/0.log" Jun 09 00:18:39.955803 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.955748 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2_68847a67-9863-4472-bf6c-fec99be89be1/pull/0.log" Jun 09 00:18:39.962206 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:39.962186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2_68847a67-9863-4472-bf6c-fec99be89be1/extract/0.log" Jun 09 00:18:40.070320 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:40.070302 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d_9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd/util/0.log" Jun 09 00:18:40.077030 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:40.077010 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d_9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd/pull/0.log" Jun 09 00:18:40.083182 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:40.083162 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d_9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd/extract/0.log" Jun 09 00:18:40.208333 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:40.208282 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5474ccdd54-wctqx_6f3a0c7b-7c05-4b5f-987d-2b48707724f0/authorino/0.log" Jun 09 00:18:40.912270 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:40.912247 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4dqvz_cccb77ff-63e5-4fc1-ac25-edf07de171d9/limitador/0.log" Jun 09 00:18:41.718354 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:41.718314 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-zm46c_c7a45a46-a634-458d-a5e5-8fb4013ea70a/kube-auth-proxy/0.log" Jun 09 00:18:42.754474 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:42.754445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp_e88ae309-34d1-4cf7-b61d-2acf9c3ad88b/main/0.log" Jun 09 00:18:42.760429 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:42.760403 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pq5kp_e88ae309-34d1-4cf7-b61d-2acf9c3ad88b/storage-initializer/0.log" Jun 09 00:18:47.509026 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.508986 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b7dvg/must-gather-9n68n"] Jun 09 00:18:47.509503 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.509482 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f46c31-6e36-4d11-a531-5ad18c2bc167" containerName="cleanup" Jun 09 00:18:47.509584 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.509506 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f46c31-6e36-4d11-a531-5ad18c2bc167" containerName="cleanup" Jun 09 00:18:47.509668 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.509649 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f46c31-6e36-4d11-a531-5ad18c2bc167" containerName="cleanup" Jun 09 00:18:47.515339 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.515306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7dvg/must-gather-9n68n" Jun 09 00:18:47.518708 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.518675 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7dvg\"/\"kube-root-ca.crt\"" Jun 09 00:18:47.519698 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.519675 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7dvg\"/\"openshift-service-ca.crt\"" Jun 09 00:18:47.519802 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.519680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b7dvg\"/\"default-dockercfg-gj2w4\"" Jun 09 00:18:47.521219 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.521187 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7dvg/must-gather-9n68n"] Jun 09 00:18:47.622115 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.622091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2644ce3-e106-434e-bd46-0fd9d57fa5e7-must-gather-output\") pod \"must-gather-9n68n\" (UID: \"d2644ce3-e106-434e-bd46-0fd9d57fa5e7\") " pod="openshift-must-gather-b7dvg/must-gather-9n68n" Jun 09 00:18:47.622234 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.622130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpm5\" (UniqueName: \"kubernetes.io/projected/d2644ce3-e106-434e-bd46-0fd9d57fa5e7-kube-api-access-sxpm5\") pod \"must-gather-9n68n\" (UID: \"d2644ce3-e106-434e-bd46-0fd9d57fa5e7\") " pod="openshift-must-gather-b7dvg/must-gather-9n68n" Jun 09 00:18:47.722862 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.722826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpm5\" (UniqueName: \"kubernetes.io/projected/d2644ce3-e106-434e-bd46-0fd9d57fa5e7-kube-api-access-sxpm5\") pod \"must-gather-9n68n\" (UID: \"d2644ce3-e106-434e-bd46-0fd9d57fa5e7\") " pod="openshift-must-gather-b7dvg/must-gather-9n68n" Jun 09 00:18:47.723039 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.722952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2644ce3-e106-434e-bd46-0fd9d57fa5e7-must-gather-output\") pod \"must-gather-9n68n\" (UID: \"d2644ce3-e106-434e-bd46-0fd9d57fa5e7\") " pod="openshift-must-gather-b7dvg/must-gather-9n68n" Jun 09 00:18:47.723266 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.723246 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2644ce3-e106-434e-bd46-0fd9d57fa5e7-must-gather-output\") pod \"must-gather-9n68n\" (UID: \"d2644ce3-e106-434e-bd46-0fd9d57fa5e7\") " pod="openshift-must-gather-b7dvg/must-gather-9n68n" Jun 09 00:18:47.732598 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.732564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpm5\" (UniqueName: \"kubernetes.io/projected/d2644ce3-e106-434e-bd46-0fd9d57fa5e7-kube-api-access-sxpm5\") pod \"must-gather-9n68n\" (UID: \"d2644ce3-e106-434e-bd46-0fd9d57fa5e7\") " pod="openshift-must-gather-b7dvg/must-gather-9n68n" Jun 09 00:18:47.827034 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.826977 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7dvg/must-gather-9n68n" Jun 09 00:18:47.961488 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.961461 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7dvg/must-gather-9n68n"] Jun 09 00:18:47.963404 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:18:47.963375 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2644ce3_e106_434e_bd46_0fd9d57fa5e7.slice/crio-2d489ce197827adb014c3e7e4aac4b14d19726adcca2ff9a3d08f2320b7bab8d WatchSource:0}: Error finding container 2d489ce197827adb014c3e7e4aac4b14d19726adcca2ff9a3d08f2320b7bab8d: Status 404 returned error can't find the container with id 2d489ce197827adb014c3e7e4aac4b14d19726adcca2ff9a3d08f2320b7bab8d Jun 09 00:18:47.965199 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:47.965182 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:18:48.428783 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:48.428748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/must-gather-9n68n" event={"ID":"d2644ce3-e106-434e-bd46-0fd9d57fa5e7","Type":"ContainerStarted","Data":"2d489ce197827adb014c3e7e4aac4b14d19726adcca2ff9a3d08f2320b7bab8d"} Jun 09 00:18:49.440050 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:49.440011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/must-gather-9n68n" event={"ID":"d2644ce3-e106-434e-bd46-0fd9d57fa5e7","Type":"ContainerStarted","Data":"30114822639b694a5b6d3b15ed7867e7debb54d12d565217711ff9e5c6113d66"} Jun 09 00:18:49.440503 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:49.440063 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/must-gather-9n68n" event={"ID":"d2644ce3-e106-434e-bd46-0fd9d57fa5e7","Type":"ContainerStarted","Data":"8293c09fb437cd85edfa111b485c6ee428e6455af535b026d6015714b4644b70"} Jun 09 00:18:49.455733 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:49.455649 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b7dvg/must-gather-9n68n" podStartSLOduration=1.680790509 podStartE2EDuration="2.455588497s" totalImagesPullingTime="774.797988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:18:49.454329995 +0000 UTC m=+1178.276431556" watchObservedRunningTime="2026-06-09 00:18:49.455588497 +0000 UTC m=+1178.277690062" Jun 09 00:18:50.272504 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:50.272474 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7m2rg_9e3d4ab4-dde7-44e8-ac52-6c70c0f2a761/global-pull-secret-syncer/0.log" Jun 09 00:18:50.432503 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:50.432469 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nvf99_5b4bab39-9475-4352-b23b-139700706808/konnectivity-agent/0.log" Jun 09 00:18:50.522855 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:50.522755 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-78.ec2.internal_d5f5c03087fe8c77fec5cfd334a5bebe/haproxy/0.log" Jun 09 00:18:54.979338 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:54.979237 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9_66661064-99ea-47aa-a91e-34dea8dfe4bf/extract/0.log" Jun 09 00:18:55.005135 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.005104 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9_66661064-99ea-47aa-a91e-34dea8dfe4bf/util/0.log" Jun 09 00:18:55.028908 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.028875 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bhgg9_66661064-99ea-47aa-a91e-34dea8dfe4bf/pull/0.log" Jun 09 00:18:55.054154 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.054124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4_20ec7104-f97f-4242-8011-f462023045cb/extract/0.log" Jun 09 00:18:55.075415 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.075388 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4_20ec7104-f97f-4242-8011-f462023045cb/util/0.log" Jun 09 00:18:55.099985 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.099954 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zhhd4_20ec7104-f97f-4242-8011-f462023045cb/pull/0.log" Jun 09 00:18:55.131094 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.131064 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2_68847a67-9863-4472-bf6c-fec99be89be1/extract/0.log" Jun 09 00:18:55.155097 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.155066 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2_68847a67-9863-4472-bf6c-fec99be89be1/util/0.log" Jun 09 00:18:55.176821 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.176776 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmdx2_68847a67-9863-4472-bf6c-fec99be89be1/pull/0.log" Jun 09 00:18:55.203799 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.203767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d_9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd/extract/0.log" Jun 09 00:18:55.226282 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.226250 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d_9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd/util/0.log" Jun 09 00:18:55.247563 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.247532 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wlc6d_9c4e3c5a-4f3d-4a77-b947-c8cee2edf2fd/pull/0.log" Jun 09 00:18:55.318072 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.318036 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5474ccdd54-wctqx_6f3a0c7b-7c05-4b5f-987d-2b48707724f0/authorino/0.log" Jun 09 00:18:55.579325 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:55.579240 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4dqvz_cccb77ff-63e5-4fc1-ac25-edf07de171d9/limitador/0.log" Jun 09 00:18:57.230336 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.230308 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8275527d-cd3e-451a-9881-8c394c87fa0b/alertmanager/0.log" Jun 09 00:18:57.251930 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.251893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8275527d-cd3e-451a-9881-8c394c87fa0b/config-reloader/0.log" Jun 09 00:18:57.275189 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.275039 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8275527d-cd3e-451a-9881-8c394c87fa0b/kube-rbac-proxy-web/0.log" Jun 09 00:18:57.303619 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.303568 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8275527d-cd3e-451a-9881-8c394c87fa0b/kube-rbac-proxy/0.log" Jun 09 00:18:57.330627 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.330575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8275527d-cd3e-451a-9881-8c394c87fa0b/kube-rbac-proxy-metric/0.log" Jun 09 00:18:57.350457 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.350424 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8275527d-cd3e-451a-9881-8c394c87fa0b/prom-label-proxy/0.log" Jun 09 00:18:57.373624 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.373577 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8275527d-cd3e-451a-9881-8c394c87fa0b/init-config-reloader/0.log" Jun 09 00:18:57.429315 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.429278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-vcslg_519e81cd-4cb5-4ffb-9f67-c7a919f7393b/cluster-monitoring-operator/0.log" Jun 09 00:18:57.454429 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.454394 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fwhmm_9ad5224f-e44d-473d-8034-bc1c7b56f667/kube-state-metrics/0.log" Jun 09 00:18:57.474106 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.474070 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fwhmm_9ad5224f-e44d-473d-8034-bc1c7b56f667/kube-rbac-proxy-main/0.log" Jun 09 00:18:57.514629 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.513541 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fwhmm_9ad5224f-e44d-473d-8034-bc1c7b56f667/kube-rbac-proxy-self/0.log" Jun 09 00:18:57.537418 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.537196 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-866cb8fcd5-q6727_4f430493-8227-4496-8a95-3630d72a99c3/metrics-server/0.log" Jun 09 00:18:57.603719 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.603689 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m22l8_942cf1e5-5383-4034-a525-7630f3f875c2/node-exporter/0.log" Jun 09 00:18:57.631639 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.631589 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m22l8_942cf1e5-5383-4034-a525-7630f3f875c2/kube-rbac-proxy/0.log" Jun 09 00:18:57.662363 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:57.662332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m22l8_942cf1e5-5383-4034-a525-7630f3f875c2/init-textfile/0.log" Jun 09 00:18:58.221101 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:58.221015 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c784d69-v78v9_77ec9814-8270-4687-8dcd-78535081a0bc/telemeter-client/0.log" Jun 09 00:18:58.244595 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:58.244561 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c784d69-v78v9_77ec9814-8270-4687-8dcd-78535081a0bc/reload/0.log" Jun 09 00:18:58.266211 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:58.266176 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c784d69-v78v9_77ec9814-8270-4687-8dcd-78535081a0bc/kube-rbac-proxy/0.log" Jun 09 00:18:59.801713 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:18:59.801672 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-2qz5n_57a995c9-bcac-4085-9d93-4dcb7d2e5249/networking-console-plugin/0.log" Jun 09 00:19:00.967117 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:00.967087 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-655b6bd488-tnzmg_d2632fd0-947e-4829-bbca-17af3355f40f/console/0.log" Jun 09 00:19:01.557357 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.557317 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68"] Jun 09 00:19:01.564910 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.564881 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.570202 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.570168 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68"] Jun 09 00:19:01.678108 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.678068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-podres\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.678412 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.678388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-sys\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.678591 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.678573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-lib-modules\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.678790 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.678776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-proc\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.678941 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.678924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2w4h\" (UniqueName: \"kubernetes.io/projected/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-kube-api-access-s2w4h\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.779968 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.779926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-podres\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.780283 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.780257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-sys\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.780470 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.780262 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-podres\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.780657 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.780337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-sys\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.780809 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.780451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-lib-modules\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.780899 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.780865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-proc\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.780961 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.780565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-lib-modules\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.780961 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.780907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2w4h\" (UniqueName: \"kubernetes.io/projected/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-kube-api-access-s2w4h\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.781075 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.781006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-proc\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.789368 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.789343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2w4h\" (UniqueName: \"kubernetes.io/projected/77cdf80c-3fc8-4c16-ab28-7e02f5285a69-kube-api-access-s2w4h\") pod \"perf-node-gather-daemonset-frn68\" (UID: \"77cdf80c-3fc8-4c16-ab28-7e02f5285a69\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:01.879843 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:01.879758 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:02.078190 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:02.077575 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68"] Jun 09 00:19:02.079806 ip-10-0-130-78 kubenswrapper[2562]: W0609 00:19:02.079752 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod77cdf80c_3fc8_4c16_ab28_7e02f5285a69.slice/crio-a23294ac6279609be5c9e73cdae28884bd21d384307b17091067ae2f9cf3eabb WatchSource:0}: Error finding container a23294ac6279609be5c9e73cdae28884bd21d384307b17091067ae2f9cf3eabb: Status 404 returned error can't find the container with id a23294ac6279609be5c9e73cdae28884bd21d384307b17091067ae2f9cf3eabb Jun 09 00:19:02.567426 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:02.567382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" event={"ID":"77cdf80c-3fc8-4c16-ab28-7e02f5285a69","Type":"ContainerStarted","Data":"bc5a5df87a228fc93b3f344fbbdb43866e48b88ef34438ddc85960484f8c8fd2"} Jun 09 00:19:02.567650 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:02.567454 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" event={"ID":"77cdf80c-3fc8-4c16-ab28-7e02f5285a69","Type":"ContainerStarted","Data":"a23294ac6279609be5c9e73cdae28884bd21d384307b17091067ae2f9cf3eabb"} Jun 09 00:19:02.568200 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:02.568175 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:02.587261 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:02.587210 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" podStartSLOduration=1.587191072 podStartE2EDuration="1.587191072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:19:02.583653679 +0000 UTC m=+1191.405755249" watchObservedRunningTime="2026-06-09 00:19:02.587191072 +0000 UTC m=+1191.409292636" Jun 09 00:19:02.973523 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:02.973441 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ddnnc_b40303a4-7e13-473f-9044-3c77f276f2fd/dns/0.log" Jun 09 00:19:02.994015 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:02.993974 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ddnnc_b40303a4-7e13-473f-9044-3c77f276f2fd/kube-rbac-proxy/0.log" Jun 09 00:19:03.040895 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:03.040871 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whcbr_f43a7ef4-2b19-4359-880d-e0a37348fe36/dns-node-resolver/0.log" Jun 09 00:19:03.552372 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:03.552343 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29682720-p5shc_552b6253-8d86-4fcf-a2d6-3e77dcea0700/image-pruner/0.log" Jun 09 00:19:03.579590 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:03.579558 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b8bbc66c7-2sq9n_62f4d32e-c86f-440f-a035-eeec5c4f50da/registry/0.log" Jun 09 00:19:03.587285 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:03.587249 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b8bbc66c7-2sq9n_62f4d32e-c86f-440f-a035-eeec5c4f50da/registry/1.log" Jun 09 00:19:03.628099 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:03.628073 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8zk8_9e2f7486-9bbd-4e3f-9548-cc6aa46e58f4/node-ca/0.log" Jun 09 00:19:04.657427 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:04.657394 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-zm46c_c7a45a46-a634-458d-a5e5-8fb4013ea70a/kube-auth-proxy/0.log" Jun 09 00:19:05.401851 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:05.401814 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6dk5_01aec00e-ba0c-4439-af7d-cfd67a3cf234/serve-healthcheck-canary/0.log" Jun 09 00:19:05.953007 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:05.952974 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx4nn_eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce/kube-rbac-proxy/0.log" Jun 09 00:19:05.972497 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:05.972471 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx4nn_eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce/exporter/0.log" Jun 09 00:19:05.993407 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:05.993384 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx4nn_eebf6bf8-356f-4e9d-b1ab-3f6819fd35ce/extractor/0.log" Jun 09 00:19:08.591566 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:08.591536 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-dmbv8_0121ebaf-1976-4c01-9785-7b4b7387f472/manager/0.log" Jun 09 00:19:08.611633 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:08.611583 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-dmbv8_0121ebaf-1976-4c01-9785-7b4b7387f472/copy-manifests/0.log" Jun 09 00:19:09.593017 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:09.592992 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-frn68" Jun 09 00:19:10.267893 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:10.267864 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f4484c748-w5s6d_59b348e7-6464-4e82-b009-cf2ec3186f7b/manager/0.log" Jun 09 00:19:10.293223 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:10.293188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7jhjc_8b4dd0de-21a4-4c74-905d-abb8baa52763/openshift-lws-operator/0.log" Jun 09 00:19:11.729202 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:11.729138 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 09 00:19:11.730594 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:11.730571 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwxxx_6995b7a1-5e3f-4866-803d-962175277565/ovn-acl-logging/0.log" Jun 09 00:19:15.205706 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:15.205674 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-zm46c_c7a45a46-a634-458d-a5e5-8fb4013ea70a/kube-auth-proxy/0.log" Jun 09 00:19:15.502475 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:15.502443 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-572fs_32149b1c-d653-4e7a-adc8-21a7625d3ae8/migrator/0.log" Jun 09 00:19:15.533625 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:15.533558 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-572fs_32149b1c-d653-4e7a-adc8-21a7625d3ae8/graceful-termination/0.log" Jun 09 00:19:16.423461 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:16.423435 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-zm46c_c7a45a46-a634-458d-a5e5-8fb4013ea70a/kube-auth-proxy/0.log" Jun 09 00:19:17.317893 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.317863 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ctthd_ecf48ff4-bce3-4f70-9245-4508c63002b4/kube-multus-additional-cni-plugins/0.log" Jun 09 00:19:17.339926 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.339900 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ctthd_ecf48ff4-bce3-4f70-9245-4508c63002b4/egress-router-binary-copy/0.log" Jun 09 00:19:17.360155 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.360132 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ctthd_ecf48ff4-bce3-4f70-9245-4508c63002b4/cni-plugins/0.log" Jun 09 00:19:17.379101 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.379076 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ctthd_ecf48ff4-bce3-4f70-9245-4508c63002b4/bond-cni-plugin/0.log" Jun 09 00:19:17.399940 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.399920 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ctthd_ecf48ff4-bce3-4f70-9245-4508c63002b4/routeoverride-cni/0.log" Jun 09 00:19:17.418771 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.418749 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ctthd_ecf48ff4-bce3-4f70-9245-4508c63002b4/whereabouts-cni-bincopy/0.log" Jun 09 00:19:17.440212 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.440182 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ctthd_ecf48ff4-bce3-4f70-9245-4508c63002b4/whereabouts-cni/0.log" Jun 09 00:19:17.671437 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.671357 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n542m_5ff80466-dd29-496b-9546-8e3619fe741b/kube-multus/0.log" Jun 09 00:19:17.779657 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.779630 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vbs7g_3ef5d3ff-9832-4b60-a130-8a41f6585f52/network-metrics-daemon/0.log" Jun 09 00:19:17.796523 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:17.796501 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vbs7g_3ef5d3ff-9832-4b60-a130-8a41f6585f52/kube-rbac-proxy/0.log" Jun 09 00:19:18.071481 ip-10-0-130-78 kubenswrapper[2562]: I0609 00:19:18.071449 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-zm46c_c7a45a46-a634-458d-a5e5-8fb4013ea70a/kube-auth-proxy/0.log"