May 21 18:11:08.715173 ip-10-0-138-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 18:11:08.715184 ip-10-0-138-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 18:11:08.715192 ip-10-0-138-244 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 18:11:08.715426 ip-10-0-138-244 systemd[1]: Failed to start Kubernetes Kubelet. May 21 18:11:20.171001 ip-10-0-138-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 18:11:20.171020 ip-10-0-138-244 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f3157c29952549919dc300c3c5531f33 -- May 21 18:13:50.312398 ip-10-0-138-244 systemd[1]: Starting Kubernetes Kubelet... May 21 18:13:50.761194 ip-10-0-138-244 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:13:50.761194 ip-10-0-138-244 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 18:13:50.761194 ip-10-0-138-244 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:13:50.761194 ip-10-0-138-244 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 18:13:50.761194 ip-10-0-138-244 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:13:50.763629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.763539 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 18:13:50.769785 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769769 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:50.769785 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769785 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769789 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769793 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769795 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769798 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769801 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769804 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769806 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769809 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769812 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769814 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769817 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769820 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769822 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769825 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769835 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769840 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769844 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769847 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:50.769853 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769850 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769854 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769857 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769860 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769863 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769866 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769868 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769871 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769873 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769876 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769879 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769882 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769884 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769887 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769890 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769892 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769895 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769898 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769900 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:50.770406 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769903 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769905 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769908 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769910 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769913 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769915 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769918 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769920 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769923 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769926 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769930 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769932 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769935 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769938 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769940 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769944 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769947 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769949 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769953 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769957 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:50.771133 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769960 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769962 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769965 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769968 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769970 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769973 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769975 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769978 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769981 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769983 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769986 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769988 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769992 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769995 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.769997 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770000 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770002 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770005 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770007 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770010 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:50.771627 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770012 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770015 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770018 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770020 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770023 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770026 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.770029 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771901 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771913 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771916 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771919 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771923 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771926 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771928 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771931 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771934 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771936 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771940 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771944 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:50.772100 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771948 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771950 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771953 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771956 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771958 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771961 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771964 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771966 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771969 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771971 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771979 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771982 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771984 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771987 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771989 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771992 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771995 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.771998 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772001 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772003 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:50.772566 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772007 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772010 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772013 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772015 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772018 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772021 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772023 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772026 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772029 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772031 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772034 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772036 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772039 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772041 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772044 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772046 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772049 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772052 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772054 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772057 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:50.773095 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772059 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772061 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772064 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772067 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772070 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772072 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772075 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772077 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772079 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772082 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772085 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772088 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772091 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772094 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772097 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772100 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772102 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772120 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772123 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772127 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:50.773589 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772130 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772132 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772137 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772141 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772144 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772148 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772150 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772153 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772155 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772158 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772160 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772163 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772165 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772168 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772237 2555 flags.go:64] FLAG: --address="0.0.0.0" May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772247 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772257 2555 flags.go:64] FLAG: --anonymous-auth="true" May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772263 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772270 2555 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772275 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772281 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 18:13:50.774077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772286 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772290 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772293 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772296 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772300 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772303 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772306 2555 flags.go:64] FLAG: --cgroup-root="" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772309 2555 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772312 2555 flags.go:64] FLAG: --client-ca-file="" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772315 2555 flags.go:64] FLAG: --cloud-config="" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772318 2555 flags.go:64] FLAG: --cloud-provider="external" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772321 2555 flags.go:64] FLAG: --cluster-dns="[]" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772326 2555 flags.go:64] FLAG: --cluster-domain="" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772329 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772332 2555 flags.go:64] FLAG: --config-dir="" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772335 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772338 2555 flags.go:64] FLAG: --container-log-max-files="5" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772344 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772347 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772350 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772353 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772356 2555 flags.go:64] FLAG: --contention-profiling="false" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772359 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772363 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772366 2555 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 18:13:50.774606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772369 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772373 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772376 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772379 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772382 2555 flags.go:64] FLAG: --enable-load-reader="false" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772385 2555 flags.go:64] FLAG: --enable-server="true" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772388 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772393 2555 flags.go:64] FLAG: --event-burst="100" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772396 2555 flags.go:64] FLAG: --event-qps="50" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772400 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772404 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772407 2555 flags.go:64] FLAG: --eviction-hard="" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772411 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772414 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772417 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772420 2555 flags.go:64] FLAG: --eviction-soft="" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772423 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772426 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772429 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772432 2555 flags.go:64] FLAG: --experimental-mounter-path="" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772435 2555 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772438 2555 flags.go:64] FLAG: --fail-swap-on="true" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772441 2555 flags.go:64] FLAG: --feature-gates="" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772445 2555 flags.go:64] FLAG: --file-check-frequency="20s" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772448 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 18:13:50.775256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772452 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772455 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772458 2555 flags.go:64] FLAG: --healthz-port="10248" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772461 2555 flags.go:64] FLAG: --help="false" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772465 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-138-244.ec2.internal" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772468 2555 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772471 2555 flags.go:64] FLAG: --http-check-frequency="20s" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772474 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772477 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772480 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772483 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772486 2555 flags.go:64] FLAG: --image-service-endpoint="" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772489 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772492 2555 flags.go:64] FLAG: --kube-api-burst="100" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772495 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772498 2555 flags.go:64] FLAG: --kube-api-qps="50" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772501 2555 flags.go:64] FLAG: --kube-reserved="" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772504 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772507 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772510 2555 flags.go:64] FLAG: --kubelet-cgroups="" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772512 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772515 2555 flags.go:64] FLAG: --lock-file="" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772519 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772522 2555 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 18:13:50.775846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772524 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772530 2555 flags.go:64] FLAG: --log-json-split-stream="false" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772532 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772535 2555 flags.go:64] FLAG: --log-text-split-stream="false" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772538 2555 flags.go:64] FLAG: --logging-format="text" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772541 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772545 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772548 2555 flags.go:64] FLAG: --manifest-url="" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772550 2555 flags.go:64] FLAG: --manifest-url-header="" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772555 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772558 2555 flags.go:64] FLAG: --max-open-files="1000000" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772562 2555 flags.go:64] FLAG: --max-pods="110" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772566 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772569 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772572 2555 flags.go:64] FLAG: --memory-manager-policy="None" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772575 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772578 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772581 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772585 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772592 2555 flags.go:64] FLAG: --node-status-max-images="50" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772595 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772598 2555 flags.go:64] FLAG: --oom-score-adj="-999" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772601 2555 flags.go:64] FLAG: --pod-cidr="" May 21 18:13:50.776439 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772604 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772609 2555 flags.go:64] FLAG: --pod-manifest-path="" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772612 2555 flags.go:64] FLAG: --pod-max-pids="-1" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772615 2555 flags.go:64] FLAG: --pods-per-core="0" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772618 2555 flags.go:64] FLAG: --port="10250" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772621 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772624 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fa7e8f6110319170" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772627 2555 flags.go:64] FLAG: --qos-reserved="" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772630 2555 flags.go:64] FLAG: --read-only-port="10255" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772633 2555 flags.go:64] FLAG: --register-node="true" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772636 2555 flags.go:64] FLAG: --register-schedulable="true" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772639 2555 flags.go:64] FLAG: --register-with-taints="" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772643 2555 flags.go:64] FLAG: --registry-burst="10" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772646 2555 flags.go:64] FLAG: --registry-qps="5" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772648 2555 flags.go:64] FLAG: --reserved-cpus="" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772651 2555 flags.go:64] FLAG: --reserved-memory="" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772655 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772658 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772661 2555 flags.go:64] FLAG: --rotate-certificates="false" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772665 2555 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772668 2555 flags.go:64] FLAG: --runonce="false" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772670 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772673 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772676 2555 flags.go:64] FLAG: --seccomp-default="false" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772679 2555 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772682 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 18:13:50.776992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772685 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772688 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772692 2555 flags.go:64] FLAG: --storage-driver-password="root" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772695 2555 flags.go:64] FLAG: --storage-driver-secure="false" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772698 2555 flags.go:64] FLAG: --storage-driver-table="stats" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772701 2555 flags.go:64] FLAG: --storage-driver-user="root" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772705 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772708 2555 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772711 2555 flags.go:64] FLAG: --system-cgroups="" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772714 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772719 2555 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772722 2555 flags.go:64] FLAG: --tls-cert-file="" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772726 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772730 2555 flags.go:64] FLAG: --tls-min-version="" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772733 2555 flags.go:64] FLAG: --tls-private-key-file="" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772737 2555 flags.go:64] FLAG: --topology-manager-policy="none" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772740 2555 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772746 2555 flags.go:64] FLAG: --topology-manager-scope="container" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772749 2555 flags.go:64] FLAG: --v="2" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772757 2555 flags.go:64] FLAG: --version="false" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772762 2555 flags.go:64] FLAG: --vmodule="" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772766 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.772769 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772857 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:50.777631 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772861 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772865 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772868 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772872 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772875 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772878 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772881 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772884 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772887 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772889 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772892 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772898 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772901 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772904 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772906 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772909 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772911 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772914 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772916 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772919 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:50.778232 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772922 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772924 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772927 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772930 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772932 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772936 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772939 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772942 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772944 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772947 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772950 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772953 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772955 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772958 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772961 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772964 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772966 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772969 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772972 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772974 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:50.778780 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772977 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772980 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772982 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772986 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772989 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772991 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772994 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.772997 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773000 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773002 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773005 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773008 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773010 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773013 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773015 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773018 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773021 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773025 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773028 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773032 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:50.779298 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773036 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773040 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773043 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773046 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773049 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773051 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773054 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773056 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773060 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773063 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773065 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773068 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773070 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773073 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773075 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773079 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773082 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773085 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773087 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:50.779784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773090 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:50.780282 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773092 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:50.780282 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773095 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:50.780282 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773098 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:50.780282 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773101 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:50.780282 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.773116 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:50.780282 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.773932 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:13:50.781859 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.781837 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 18:13:50.781893 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.781859 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 18:13:50.781928 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781909 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:50.781928 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781916 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:50.781928 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781919 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:50.781928 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781923 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:50.781928 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781926 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:50.781928 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781929 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:50.781928 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781932 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781935 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781937 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781940 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781943 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781945 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781948 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781951 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781953 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781957 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781959 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781962 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781965 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781967 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781970 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781973 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781975 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781978 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781981 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781983 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:50.782118 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781986 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781988 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781991 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781994 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781996 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.781999 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782002 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782004 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782007 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782010 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782012 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782015 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782017 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782020 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782023 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782026 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782028 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782031 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782034 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782036 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:50.782622 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782039 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782042 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782044 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782047 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782049 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782052 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782055 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782059 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782063 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782066 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782069 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782072 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782075 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782077 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782080 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782083 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782085 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782088 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782091 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:50.783096 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782094 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782097 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782101 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782118 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782123 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782127 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782131 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782134 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782137 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782140 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782143 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782146 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782149 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782151 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782154 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782156 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782159 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782162 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782164 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:50.783616 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782167 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782169 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.782175 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782275 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782279 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782282 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782285 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782287 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782290 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782292 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782295 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782298 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782300 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782304 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782307 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782309 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:50.784089 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782312 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782332 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782336 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782339 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782343 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782346 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782349 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782352 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782355 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782357 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782360 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782362 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782365 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782367 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782370 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782373 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782375 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782377 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782380 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:50.784498 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782382 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782385 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782387 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782390 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782392 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782395 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782397 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782401 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782405 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782408 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782410 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782414 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782417 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782420 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782422 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782425 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782428 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782431 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782434 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:50.784959 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782436 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782439 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782441 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782444 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782446 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782449 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782452 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782454 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782457 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782459 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782462 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782464 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782468 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782472 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782474 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782477 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782479 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782482 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782484 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:50.785454 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782487 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782489 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782492 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782494 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782497 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782500 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782503 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782506 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782508 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782511 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782521 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782525 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782528 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782530 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782533 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:50.782536 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:50.785908 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.782540 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:13:50.786314 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.783195 2555 server.go:962] "Client rotation is on, will bootstrap in background" May 21 18:13:50.786314 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.786014 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 18:13:50.786930 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.786917 2555 server.go:1019] "Starting client certificate rotation" May 21 18:13:50.787030 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.787015 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 18:13:50.787065 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.787045 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 18:13:50.809754 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.809730 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 18:13:50.811747 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.811725 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 18:13:50.827117 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.827081 2555 log.go:25] "Validated CRI v1 runtime API" May 21 18:13:50.833891 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.833874 2555 log.go:25] "Validated CRI v1 image API" May 21 18:13:50.837245 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.837225 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 18:13:50.841807 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.841782 2555 fs.go:135] Filesystem UUIDs: map[5d128f4e-fe48-481f-ba6a-d29da5f87216:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b7c3cdce-acc2-4b99-83f6-3145fe278dde:/dev/nvme0n1p4] May 21 18:13:50.841873 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.841807 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 18:13:50.846127 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.845992 2555 manager.go:217] Machine: {Timestamp:2026-05-21 18:13:50.845483311 +0000 UTC m=+0.409574564 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109200 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba69475fe1d342ec032e2ef30bd77 SystemUUID:ec2ba694-75fe-1d34-2ec0-32e2ef30bd77 BootID:f3157c29-9525-4991-9dc3-00c3c5531f33 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b3:a0:7e:3a:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b3:a0:7e:3a:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:04:72:0b:73:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 18:13:50.846793 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.846780 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 18:13:50.846896 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.846883 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 18:13:50.847953 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.847928 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 18:13:50.848159 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.847955 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 18:13:50.848202 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.848173 2555 topology_manager.go:138] "Creating topology manager with none policy" May 21 18:13:50.848202 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.848181 2555 container_manager_linux.go:306] "Creating device plugin manager" May 21 18:13:50.848202 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.848188 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 18:13:50.849029 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.849019 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 18:13:50.849848 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.849838 2555 state_mem.go:36] "Initialized new in-memory state store" May 21 18:13:50.849958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.849949 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 18:13:50.850854 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.850838 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 18:13:50.853228 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.853214 2555 kubelet.go:491] "Attempting to sync node with API server" May 21 18:13:50.853266 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.853234 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 18:13:50.853266 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.853247 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 18:13:50.853266 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.853256 2555 kubelet.go:397] "Adding apiserver pod source" May 21 18:13:50.853266 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.853264 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 18:13:50.854378 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.854361 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 18:13:50.854451 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.854389 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 18:13:50.857578 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.857561 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 18:13:50.862358 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.862340 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 18:13:50.863697 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863683 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863706 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863716 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863723 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863733 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863738 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863744 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863750 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863757 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863763 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 18:13:50.863767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863771 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 18:13:50.864019 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.863778 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 18:13:50.864336 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.864301 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 18:13:50.864416 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.864319 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 18:13:50.864564 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.864555 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 18:13:50.864564 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.864565 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 18:13:50.867610 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.867595 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 18:13:50.867685 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.867632 2555 server.go:1295] "Started kubelet" May 21 18:13:50.867760 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.867731 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 18:13:50.867793 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.867738 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 18:13:50.867824 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.867795 2555 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 18:13:50.868628 ip-10-0-138-244 systemd[1]: Started Kubernetes Kubelet. May 21 18:13:50.869595 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.869571 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 18:13:50.870760 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.870743 2555 server.go:317] "Adding debug handlers to kubelet server" May 21 18:13:50.874438 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.874421 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 18:13:50.874611 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.874592 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rz69" May 21 18:13:50.874974 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.874958 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 18:13:50.875078 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875064 2555 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 18:13:50.875078 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875079 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 18:13:50.875230 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875218 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 18:13:50.875305 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875294 2555 reconstruct.go:97] "Volume reconstruction finished" May 21 18:13:50.875344 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875305 2555 reconciler.go:26] "Reconciler: start to sync state" May 21 18:13:50.875344 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875310 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 18:13:50.875653 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875639 2555 factory.go:55] Registering systemd factory May 21 18:13:50.875733 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875665 2555 factory.go:223] Registration of the systemd container factory successfully May 21 18:13:50.875792 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.875747 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:50.875868 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875857 2555 factory.go:153] Registering CRI-O factory May 21 18:13:50.875903 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875870 2555 factory.go:223] Registration of the crio container factory successfully May 21 18:13:50.875932 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875912 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 18:13:50.875932 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875927 2555 factory.go:103] Registering Raw factory May 21 18:13:50.876002 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.875942 2555 manager.go:1196] Started watching for new ooms in manager May 21 18:13:50.876064 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.875161 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-244.ec2.internal.18b1a74245bad4ce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-244.ec2.internal,UID:ip-10-0-138-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-244.ec2.internal,},FirstTimestamp:2026-05-21 18:13:50.867608782 +0000 UTC m=+0.431700034,LastTimestamp:2026-05-21 18:13:50.867608782 +0000 UTC m=+0.431700034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-244.ec2.internal,}" May 21 18:13:50.876695 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.876675 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 18:13:50.877096 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.877081 2555 manager.go:319] Starting recovery of all containers May 21 18:13:50.878658 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.878628 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 18:13:50.878778 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.878757 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 18:13:50.882156 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.882135 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rz69" May 21 18:13:50.887997 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.887850 2555 manager.go:324] Recovery completed May 21 18:13:50.892744 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.892732 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:50.895136 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.895119 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:50.895202 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.895146 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:50.895202 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.895156 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:50.895596 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.895583 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 18:13:50.895649 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.895606 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 18:13:50.895649 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.895622 2555 state_mem.go:36] "Initialized new in-memory state store" May 21 18:13:50.896989 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.896928 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-244.ec2.internal.18b1a742475ed771 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-244.ec2.internal,UID:ip-10-0-138-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-244.ec2.internal,},FirstTimestamp:2026-05-21 18:13:50.895134577 +0000 UTC m=+0.459225829,LastTimestamp:2026-05-21 18:13:50.895134577 +0000 UTC m=+0.459225829,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-244.ec2.internal,}" May 21 18:13:50.898340 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.898325 2555 policy_none.go:49] "None policy: Start" May 21 18:13:50.898340 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.898343 2555 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 18:13:50.898445 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.898354 2555 state_mem.go:35] "Initializing new in-memory state store" May 21 18:13:50.936996 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.936980 2555 manager.go:341] "Starting Device Plugin manager" May 21 18:13:50.937136 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.937013 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 18:13:50.937136 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.937027 2555 server.go:85] "Starting device plugin registration server" May 21 18:13:50.937312 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.937297 2555 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 18:13:50.937312 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.937313 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 18:13:50.937484 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.937450 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 18:13:50.937566 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.937544 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 18:13:50.937566 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:50.937555 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 18:13:50.938181 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.938161 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 18:13:50.938253 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:50.938200 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.014858 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.014779 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 18:13:51.015995 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.015981 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 18:13:51.016074 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.016003 2555 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 18:13:51.016074 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.016027 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 18:13:51.016074 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.016036 2555 kubelet.go:2451] "Starting kubelet main sync loop" May 21 18:13:51.016226 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.016084 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 18:13:51.018343 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.018322 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:51.038298 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.038266 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:51.039349 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.039332 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:51.039434 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.039362 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:51.039434 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.039377 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:51.039434 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.039400 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-244.ec2.internal" May 21 18:13:51.046950 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.046935 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-244.ec2.internal" May 21 18:13:51.047023 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.046956 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-244.ec2.internal\": node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.066873 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.066850 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.116907 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.116876 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal"] May 21 18:13:51.117035 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.116946 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:51.118675 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.118657 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:51.118773 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.118687 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:51.118773 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.118701 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:51.120027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120013 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:51.120203 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120187 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" May 21 18:13:51.120296 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120215 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:51.120740 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120717 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:51.120825 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120746 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:51.120825 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120755 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:51.120825 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120717 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:51.120825 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120798 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:51.120825 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.120813 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:51.122038 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.122022 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:51.122089 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.122055 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:51.122671 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.122656 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:51.122745 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.122677 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:51.122745 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.122688 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:51.153800 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.153770 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-244.ec2.internal\" not found" node="ip-10-0-138-244.ec2.internal" May 21 18:13:51.158060 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.158044 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-244.ec2.internal\" not found" node="ip-10-0-138-244.ec2.internal" May 21 18:13:51.167409 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.167393 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.177286 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.177266 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1196ce77df638362ef94db162acdbf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal\" (UID: \"a1196ce77df638362ef94db162acdbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:51.177371 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.177299 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1196ce77df638362ef94db162acdbf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal\" (UID: \"a1196ce77df638362ef94db162acdbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:51.177371 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.177330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17c8340ff36fd99f490f39bff53685ee-config\") pod \"kube-apiserver-proxy-ip-10-0-138-244.ec2.internal\" (UID: \"17c8340ff36fd99f490f39bff53685ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" May 21 18:13:51.268551 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.268461 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.277824 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.277800 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1196ce77df638362ef94db162acdbf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal\" (UID: \"a1196ce77df638362ef94db162acdbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:51.277887 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.277828 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1196ce77df638362ef94db162acdbf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal\" (UID: \"a1196ce77df638362ef94db162acdbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:51.277887 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.277847 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17c8340ff36fd99f490f39bff53685ee-config\") pod \"kube-apiserver-proxy-ip-10-0-138-244.ec2.internal\" (UID: \"17c8340ff36fd99f490f39bff53685ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" May 21 18:13:51.277887 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.277873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17c8340ff36fd99f490f39bff53685ee-config\") pod \"kube-apiserver-proxy-ip-10-0-138-244.ec2.internal\" (UID: \"17c8340ff36fd99f490f39bff53685ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" May 21 18:13:51.277989 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.277897 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1196ce77df638362ef94db162acdbf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal\" (UID: \"a1196ce77df638362ef94db162acdbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:51.277989 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.277905 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1196ce77df638362ef94db162acdbf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal\" (UID: \"a1196ce77df638362ef94db162acdbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:51.369269 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.369226 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.456750 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.456713 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" May 21 18:13:51.460262 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.460242 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:51.469916 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.469895 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.570513 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.570411 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.670931 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.670892 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.771457 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.771422 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.787884 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.787859 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 18:13:51.788013 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.787997 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 18:13:51.872530 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.872464 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.874585 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.874570 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 18:13:51.884767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.884724 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 18:08:50 +0000 UTC" deadline="2027-11-20 11:58:18.503286329 +0000 UTC" May 21 18:13:51.884767 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.884762 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13145h44m26.618527316s" May 21 18:13:51.893663 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.893643 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 18:13:51.919261 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.919225 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v7spn" May 21 18:13:51.926149 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.926127 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v7spn" May 21 18:13:51.973532 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:51.973504 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:51.994444 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:51.994403 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c8340ff36fd99f490f39bff53685ee.slice/crio-77936aafe7725070dbda1c46651a2895605069e7ab159e6f65808ae9d91106db WatchSource:0}: Error finding container 77936aafe7725070dbda1c46651a2895605069e7ab159e6f65808ae9d91106db: Status 404 returned error can't find the container with id 77936aafe7725070dbda1c46651a2895605069e7ab159e6f65808ae9d91106db May 21 18:13:51.994674 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:51.994652 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1196ce77df638362ef94db162acdbf1.slice/crio-fb1018a6c69438f70f5f0daa5dd517ead4ed70090eddb2c382ab6af5757a473b WatchSource:0}: Error finding container fb1018a6c69438f70f5f0daa5dd517ead4ed70090eddb2c382ab6af5757a473b: Status 404 returned error can't find the container with id fb1018a6c69438f70f5f0daa5dd517ead4ed70090eddb2c382ab6af5757a473b May 21 18:13:51.998910 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:51.998895 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:13:52.018817 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.018769 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" event={"ID":"17c8340ff36fd99f490f39bff53685ee","Type":"ContainerStarted","Data":"77936aafe7725070dbda1c46651a2895605069e7ab159e6f65808ae9d91106db"} May 21 18:13:52.019620 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.019598 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" event={"ID":"a1196ce77df638362ef94db162acdbf1","Type":"ContainerStarted","Data":"fb1018a6c69438f70f5f0daa5dd517ead4ed70090eddb2c382ab6af5757a473b"} May 21 18:13:52.073812 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.073762 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:52.174309 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.174235 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:52.264912 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.264887 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:52.274572 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.274553 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:52.375298 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.375264 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-244.ec2.internal\" not found" May 21 18:13:52.426989 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.426913 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:52.439208 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.439186 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:52.476052 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.476018 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" May 21 18:13:52.488339 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.488313 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 18:13:52.489311 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.489291 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" May 21 18:13:52.500977 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.500956 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 18:13:52.854557 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.854527 2555 apiserver.go:52] "Watching apiserver" May 21 18:13:52.860241 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.860216 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 18:13:52.860718 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.860695 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-hrv95","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal","openshift-multus/multus-additional-cni-plugins-j82jz","openshift-multus/multus-cdm4l","kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal","openshift-multus/network-metrics-daemon-b8mgd","openshift-network-diagnostics/network-check-target-xj4l2","openshift-network-operator/iptables-alerter-lt56c","openshift-ovn-kubernetes/ovnkube-node-76cmd","kube-system/konnectivity-agent-62l8t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298","openshift-cluster-node-tuning-operator/tuned-hknvb","openshift-dns/node-resolver-jl9vw"] May 21 18:13:52.862388 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.862368 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:52.862490 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.862466 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:13:52.863633 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.863610 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.864808 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.864788 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdm4l" May 21 18:13:52.866385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.865844 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 18:13:52.866385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.865994 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:52.866385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.866030 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hwvp9\"" May 21 18:13:52.866385 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.866063 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:13:52.866385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.866086 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 18:13:52.866385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.866219 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 18:13:52.866385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.866264 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 18:13:52.866385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.866281 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 18:13:52.866926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.866804 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g7bhq\"" May 21 18:13:52.866926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.866906 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 18:13:52.868563 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.867641 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.869904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.869473 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 18:13:52.869904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.869763 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jkmh\"" May 21 18:13:52.869904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.869823 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 18:13:52.869904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.869825 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 18:13:52.870195 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.870094 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.871816 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.871573 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.872587 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.872374 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 18:13:52.872587 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.872506 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.873682 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.873722 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rhn4h\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.873778 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-62l8t" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.874289 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.874667 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.874889 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ttvzl\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.874971 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.875328 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.875360 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.875674 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 18:13:52.876363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.876309 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4r8nq\"" May 21 18:13:52.877020 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.876636 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 18:13:52.877176 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.877157 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.877290 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.877266 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.877944 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.877918 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 18:13:52.881444 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.881400 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:52.881878 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.881863 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 18:13:52.882230 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.882212 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 18:13:52.882230 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.882226 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 18:13:52.882398 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.881883 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 18:13:52.882803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.881913 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 18:13:52.882803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.882543 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4lt6f\"" May 21 18:13:52.882803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.882569 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pskrn\"" May 21 18:13:52.884024 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.884004 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 18:13:52.884125 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.884050 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7kd5p\"" May 21 18:13:52.884333 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.884307 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 18:13:52.886484 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886459 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-var-lib-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.886586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886507 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-run-ovn-kubernetes\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.886586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-ovnkube-config\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.886586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886562 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-socket-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.886741 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886632 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-cni-bin\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.886741 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886680 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-cni-multus\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.886741 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2g5q\" (UniqueName: \"kubernetes.io/projected/f2794223-39cf-49e2-a1d6-2d646f51b7a3-kube-api-access-r2g5q\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.886884 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-ovn\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.886884 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.886884 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886824 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-lib-modules\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.886884 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-os-release\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887079 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886898 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-multus-certs\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887079 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2794223-39cf-49e2-a1d6-2d646f51b7a3-host-slash\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.887079 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-log-socket\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.887079 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.886989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de02aac3-fecd-4d58-bc01-3cf604065216-ovn-node-metrics-cert\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.887079 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887019 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-cnibin\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.887079 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-cni-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887079 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-netns\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887097 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzbfx\" (UniqueName: \"kubernetes.io/projected/56921e05-de60-4edd-9ec7-26b8855265f0-kube-api-access-jzbfx\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-modprobe-d\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887180 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-host\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887210 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-cni-binary-copy\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887243 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-system-cni-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887286 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-conf-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-sys-fs\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysctl-conf\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887360 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-sys\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887384 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-hostroot\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-systemd\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-cni-bin\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-tuned\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887526 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4xk\" (UniqueName: \"kubernetes.io/projected/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-kube-api-access-tx4xk\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-system-cni-dir\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56921e05-de60-4edd-9ec7-26b8855265f0-multus-daemon-config\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887603 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5493a7d9-c08d-4fdb-9917-ee56c14088ce-host\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2794223-39cf-49e2-a1d6-2d646f51b7a3-iptables-alerter-script\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887662 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-etc-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887688 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887710 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-cnibin\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887734 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z44bv\" (UniqueName: \"kubernetes.io/projected/de02aac3-fecd-4d58-bc01-3cf604065216-kube-api-access-z44bv\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887757 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxmw\" (UniqueName: \"kubernetes.io/projected/f3737356-a09a-41d6-9bcb-c43b95694bdd-kube-api-access-rxxmw\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l848t\" (UniqueName: \"kubernetes.io/projected/3d0e470d-d4b0-49a8-877b-082639da824c-kube-api-access-l848t\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-socket-dir-parent\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.887983 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-cni-netd\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887884 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6673235-c26d-44ce-bb74-415390b94b13-agent-certs\") pod \"konnectivity-agent-62l8t\" (UID: \"f6673235-c26d-44ce-bb74-415390b94b13\") " pod="kube-system/konnectivity-agent-62l8t" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887944 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-systemd-units\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887967 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-registration-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.887989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysconfig\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysctl-d\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-tmp\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888075 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56921e05-de60-4edd-9ec7-26b8855265f0-cni-binary-copy\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888097 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-k8s-cni-cncf-io\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-kubelet\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888165 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888195 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-slash\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-var-lib-kubelet\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-os-release\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.888721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888328 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-etc-kubernetes\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn6hq\" (UniqueName: \"kubernetes.io/projected/4e102289-f8a8-475e-8f4e-422e0a01eed3-kube-api-access-fn6hq\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsxnl\" (UniqueName: \"kubernetes.io/projected/5493a7d9-c08d-4fdb-9917-ee56c14088ce-kube-api-access-xsxnl\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-run\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-node-log\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6673235-c26d-44ce-bb74-415390b94b13-konnectivity-ca\") pod \"konnectivity-agent-62l8t\" (UID: \"f6673235-c26d-44ce-bb74-415390b94b13\") " pod="kube-system/konnectivity-agent-62l8t" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-systemd\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888545 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888577 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5493a7d9-c08d-4fdb-9917-ee56c14088ce-serviceca\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888603 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-kubelet\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888642 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-run-netns\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888666 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-kubernetes\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888691 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-env-overrides\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888737 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-ovnkube-script-lib\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.889509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.888770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-device-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.927066 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.927032 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:08:51 +0000 UTC" deadline="2027-12-29 09:01:53.256738879 +0000 UTC" May 21 18:13:52.927066 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.927066 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14078h48m0.329676764s" May 21 18:13:52.976061 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.976025 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 18:13:52.989252 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989221 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysctl-conf\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.989404 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989256 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-sys\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.989404 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989282 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.989404 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989305 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-hostroot\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.989404 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989327 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-systemd\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.989404 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989350 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-cni-bin\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.989404 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989372 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-tuned\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.989404 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989386 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysctl-conf\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.989404 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989393 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4xk\" (UniqueName: \"kubernetes.io/projected/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-kube-api-access-tx4xk\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989416 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-system-cni-dir\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989442 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56921e05-de60-4edd-9ec7-26b8855265f0-multus-daemon-config\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-cni-bin\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989474 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-systemd\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-sys\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-hostroot\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989505 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-system-cni-dir\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989511 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5493a7d9-c08d-4fdb-9917-ee56c14088ce-host\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989467 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5493a7d9-c08d-4fdb-9917-ee56c14088ce-host\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989565 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2794223-39cf-49e2-a1d6-2d646f51b7a3-iptables-alerter-script\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989597 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-etc-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989641 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzhk\" (UniqueName: \"kubernetes.io/projected/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-kube-api-access-tfzhk\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989670 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989701 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-cnibin\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989727 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z44bv\" (UniqueName: \"kubernetes.io/projected/de02aac3-fecd-4d58-bc01-3cf604065216-kube-api-access-z44bv\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.989815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989782 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-etc-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.989836 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990141 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-cnibin\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990177 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990189 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56921e05-de60-4edd-9ec7-26b8855265f0-multus-daemon-config\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990181 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxmw\" (UniqueName: \"kubernetes.io/projected/f3737356-a09a-41d6-9bcb-c43b95694bdd-kube-api-access-rxxmw\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2794223-39cf-49e2-a1d6-2d646f51b7a3-iptables-alerter-script\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990241 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l848t\" (UniqueName: \"kubernetes.io/projected/3d0e470d-d4b0-49a8-877b-082639da824c-kube-api-access-l848t\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990268 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-socket-dir-parent\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990301 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990327 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-cni-netd\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990365 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-socket-dir-parent\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990382 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6673235-c26d-44ce-bb74-415390b94b13-agent-certs\") pod \"konnectivity-agent-62l8t\" (UID: \"f6673235-c26d-44ce-bb74-415390b94b13\") " pod="kube-system/konnectivity-agent-62l8t" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990421 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990427 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-cni-netd\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990449 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.990559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990477 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-hosts-file\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990509 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-tmp-dir\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990534 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-systemd-units\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990559 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-registration-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990580 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysconfig\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990608 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysctl-d\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990632 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-tmp\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990650 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990657 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56921e05-de60-4edd-9ec7-26b8855265f0-cni-binary-copy\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990683 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-k8s-cni-cncf-io\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990704 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-registration-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990709 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-kubelet\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990736 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990748 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-systemd-units\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990762 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-slash\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990788 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990798 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysctl-d\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.991319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990812 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-sysconfig\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990816 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-var-lib-kubelet\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990843 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-os-release\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990854 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-kubelet\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990868 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-etc-kubernetes\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990895 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fn6hq\" (UniqueName: \"kubernetes.io/projected/4e102289-f8a8-475e-8f4e-422e0a01eed3-kube-api-access-fn6hq\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.990900 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990922 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsxnl\" (UniqueName: \"kubernetes.io/projected/5493a7d9-c08d-4fdb-9917-ee56c14088ce-kube-api-access-xsxnl\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990945 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-run\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.990977 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs podName:4e102289-f8a8-475e-8f4e-422e0a01eed3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:53.490939363 +0000 UTC m=+3.055030609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs") pod "network-metrics-daemon-b8mgd" (UID: "4e102289-f8a8-475e-8f4e-422e0a01eed3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.990991 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-run\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991037 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991092 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-var-lib-kubelet\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991171 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-os-release\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991206 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-node-log\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991213 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-etc-kubernetes\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6673235-c26d-44ce-bb74-415390b94b13-konnectivity-ca\") pod \"konnectivity-agent-62l8t\" (UID: \"f6673235-c26d-44ce-bb74-415390b94b13\") " pod="kube-system/konnectivity-agent-62l8t" May 21 18:13:52.992080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991259 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-systemd\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991286 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991310 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5493a7d9-c08d-4fdb-9917-ee56c14088ce-serviceca\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991333 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-kubelet\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991378 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-run-netns\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991402 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-kubernetes\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991428 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991454 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-env-overrides\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991472 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-systemd\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56921e05-de60-4edd-9ec7-26b8855265f0-cni-binary-copy\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991481 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-ovnkube-script-lib\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991516 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-slash\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991535 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-device-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991566 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-var-lib-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991583 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-k8s-cni-cncf-io\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991591 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-run-ovn-kubernetes\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991622 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-ovnkube-config\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.992849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991626 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-run-ovn-kubernetes\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991652 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-socket-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991672 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-device-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991677 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-cni-bin\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991711 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-var-lib-openvswitch\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991724 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-cni-bin\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991737 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-cni-multus\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991763 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2g5q\" (UniqueName: \"kubernetes.io/projected/f2794223-39cf-49e2-a1d6-2d646f51b7a3-kube-api-access-r2g5q\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991789 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-ovn\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991813 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991836 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-lib-modules\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991860 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-os-release\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991884 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-multus-certs\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991909 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2794223-39cf-49e2-a1d6-2d646f51b7a3-host-slash\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991935 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-log-socket\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991959 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de02aac3-fecd-4d58-bc01-3cf604065216-ovn-node-metrics-cert\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.991989 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-cnibin\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.993645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992016 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-cni-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992014 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6673235-c26d-44ce-bb74-415390b94b13-konnectivity-ca\") pod \"konnectivity-agent-62l8t\" (UID: \"f6673235-c26d-44ce-bb74-415390b94b13\") " pod="kube-system/konnectivity-agent-62l8t" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992055 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-node-log\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-ovnkube-script-lib\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992069 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-var-lib-cni-multus\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992094 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-run-ovn\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992155 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992150 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-netns\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992196 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-ovnkube-config\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992237 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-lib-modules\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992263 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-kubernetes\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d0e470d-d4b0-49a8-877b-082639da824c-cnibin\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992309 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-kubelet\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992339 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-host-run-netns\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992359 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2794223-39cf-49e2-a1d6-2d646f51b7a3-host-slash\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992396 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-cni-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992398 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-multus-certs\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de02aac3-fecd-4d58-bc01-3cf604065216-log-socket\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.994274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992089 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-host-run-netns\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992480 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzbfx\" (UniqueName: \"kubernetes.io/projected/56921e05-de60-4edd-9ec7-26b8855265f0-kube-api-access-jzbfx\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992506 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-modprobe-d\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992530 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-host\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992554 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-cni-binary-copy\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992560 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-socket-dir\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992581 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-system-cni-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992605 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-conf-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992632 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-sys-fs\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992708 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3737356-a09a-41d6-9bcb-c43b95694bdd-sys-fs\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992859 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-os-release\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992949 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-modprobe-d\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992955 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de02aac3-fecd-4d58-bc01-3cf604065216-env-overrides\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.992994 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-host\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.993023 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-system-cni-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.993032 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56921e05-de60-4edd-9ec7-26b8855265f0-multus-conf-dir\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.993277 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5493a7d9-c08d-4fdb-9917-ee56c14088ce-serviceca\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:52.994853 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.993496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d0e470d-d4b0-49a8-877b-082639da824c-cni-binary-copy\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:52.995541 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.993541 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-etc-tuned\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.995541 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.993576 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-tmp\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.995541 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.993942 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6673235-c26d-44ce-bb74-415390b94b13-agent-certs\") pod \"konnectivity-agent-62l8t\" (UID: \"f6673235-c26d-44ce-bb74-415390b94b13\") " pod="kube-system/konnectivity-agent-62l8t" May 21 18:13:52.995541 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.994766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de02aac3-fecd-4d58-bc01-3cf604065216-ovn-node-metrics-cert\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.997866 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.997520 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z44bv\" (UniqueName: \"kubernetes.io/projected/de02aac3-fecd-4d58-bc01-3cf604065216-kube-api-access-z44bv\") pod \"ovnkube-node-76cmd\" (UID: \"de02aac3-fecd-4d58-bc01-3cf604065216\") " pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:52.997866 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.997648 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:52.997866 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.997666 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:52.997866 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.997679 2555 projected.go:194] Error preparing data for projected volume kube-api-access-br5hb for pod openshift-network-diagnostics/network-check-target-xj4l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:52.997866 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:52.997738 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb podName:f8bb9116-e94b-48be-9490-f716b72a291e nodeName:}" failed. No retries permitted until 2026-05-21 18:13:53.497721828 +0000 UTC m=+3.061813067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-br5hb" (UniqueName: "kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb") pod "network-check-target-xj4l2" (UID: "f8bb9116-e94b-48be-9490-f716b72a291e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:52.998213 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.997960 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4xk\" (UniqueName: \"kubernetes.io/projected/d9aa3f64-29a9-4f73-9583-7c66d32d62f6-kube-api-access-tx4xk\") pod \"tuned-hknvb\" (UID: \"d9aa3f64-29a9-4f73-9583-7c66d32d62f6\") " pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:52.998849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:52.998823 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxmw\" (UniqueName: \"kubernetes.io/projected/f3737356-a09a-41d6-9bcb-c43b95694bdd-kube-api-access-rxxmw\") pod \"aws-ebs-csi-driver-node-5g298\" (UID: \"f3737356-a09a-41d6-9bcb-c43b95694bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:53.000384 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.000358 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2g5q\" (UniqueName: \"kubernetes.io/projected/f2794223-39cf-49e2-a1d6-2d646f51b7a3-kube-api-access-r2g5q\") pod \"iptables-alerter-lt56c\" (UID: \"f2794223-39cf-49e2-a1d6-2d646f51b7a3\") " pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:53.000499 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.000387 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l848t\" (UniqueName: \"kubernetes.io/projected/3d0e470d-d4b0-49a8-877b-082639da824c-kube-api-access-l848t\") pod \"multus-additional-cni-plugins-j82jz\" (UID: \"3d0e470d-d4b0-49a8-877b-082639da824c\") " pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:53.000793 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.000751 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn6hq\" (UniqueName: \"kubernetes.io/projected/4e102289-f8a8-475e-8f4e-422e0a01eed3-kube-api-access-fn6hq\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:53.001363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.001343 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsxnl\" (UniqueName: \"kubernetes.io/projected/5493a7d9-c08d-4fdb-9917-ee56c14088ce-kube-api-access-xsxnl\") pod \"node-ca-hrv95\" (UID: \"5493a7d9-c08d-4fdb-9917-ee56c14088ce\") " pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:53.002062 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.002043 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzbfx\" (UniqueName: \"kubernetes.io/projected/56921e05-de60-4edd-9ec7-26b8855265f0-kube-api-access-jzbfx\") pod \"multus-cdm4l\" (UID: \"56921e05-de60-4edd-9ec7-26b8855265f0\") " pod="openshift-multus/multus-cdm4l" May 21 18:13:53.093036 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.092923 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzhk\" (UniqueName: \"kubernetes.io/projected/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-kube-api-access-tfzhk\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:53.093036 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.092982 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-hosts-file\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:53.093036 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.093011 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-tmp-dir\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:53.093325 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.093146 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-hosts-file\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:53.093442 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.093424 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-tmp-dir\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:53.100722 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.100692 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzhk\" (UniqueName: \"kubernetes.io/projected/a8bfa48b-d2e0-4202-a074-f0dfff223c4a-kube-api-access-tfzhk\") pod \"node-resolver-jl9vw\" (UID: \"a8bfa48b-d2e0-4202-a074-f0dfff223c4a\") " pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:53.177806 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.177718 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j82jz" May 21 18:13:53.187629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.187599 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdm4l" May 21 18:13:53.198000 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.197976 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hrv95" May 21 18:13:53.205599 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.205577 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lt56c" May 21 18:13:53.214265 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.214246 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:13:53.219944 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.219905 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-62l8t" May 21 18:13:53.227602 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.227574 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hknvb" May 21 18:13:53.234239 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.234210 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" May 21 18:13:53.238869 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.238844 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jl9vw" May 21 18:13:53.285508 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.285474 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:53.495193 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.495155 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:53.495378 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:53.495293 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:53.495447 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:53.495387 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs podName:4e102289-f8a8-475e-8f4e-422e0a01eed3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:54.49536646 +0000 UTC m=+4.059457700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs") pod "network-metrics-daemon-b8mgd" (UID: "4e102289-f8a8-475e-8f4e-422e0a01eed3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:53.595886 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.595857 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:53.596051 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:53.596036 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:53.596095 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:53.596058 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:53.596095 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:53.596072 2555 projected.go:194] Error preparing data for projected volume kube-api-access-br5hb for pod openshift-network-diagnostics/network-check-target-xj4l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:53.596182 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:53.596155 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb podName:f8bb9116-e94b-48be-9490-f716b72a291e nodeName:}" failed. No retries permitted until 2026-05-21 18:13:54.596134005 +0000 UTC m=+4.160225246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-br5hb" (UniqueName: "kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb") pod "network-check-target-xj4l2" (UID: "f8bb9116-e94b-48be-9490-f716b72a291e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:53.717435 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.717391 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2794223_39cf_49e2_a1d6_2d646f51b7a3.slice/crio-c569fb953a10611bf4f000d0c74b845897d10e249adbfbc26176789cb542a430 WatchSource:0}: Error finding container c569fb953a10611bf4f000d0c74b845897d10e249adbfbc26176789cb542a430: Status 404 returned error can't find the container with id c569fb953a10611bf4f000d0c74b845897d10e249adbfbc26176789cb542a430 May 21 18:13:53.734038 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.734014 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9aa3f64_29a9_4f73_9583_7c66d32d62f6.slice/crio-cf4efff6981b2cfa05945863b9358d9a6eea2935d82b849ce1d772fcdbae53d9 WatchSource:0}: Error finding container cf4efff6981b2cfa05945863b9358d9a6eea2935d82b849ce1d772fcdbae53d9: Status 404 returned error can't find the container with id cf4efff6981b2cfa05945863b9358d9a6eea2935d82b849ce1d772fcdbae53d9 May 21 18:13:53.736870 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.736836 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bfa48b_d2e0_4202_a074_f0dfff223c4a.slice/crio-50728a2f76a700afe6bc53453fb54e3d43d1a05502846ad6cab805241bb56e49 WatchSource:0}: Error finding container 50728a2f76a700afe6bc53453fb54e3d43d1a05502846ad6cab805241bb56e49: Status 404 returned error can't find the container with id 50728a2f76a700afe6bc53453fb54e3d43d1a05502846ad6cab805241bb56e49 May 21 18:13:53.738253 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.738212 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5493a7d9_c08d_4fdb_9917_ee56c14088ce.slice/crio-4b769b43c478a075875e20df4fc7f13df70902c4fea02bda34662b08a1b31e08 WatchSource:0}: Error finding container 4b769b43c478a075875e20df4fc7f13df70902c4fea02bda34662b08a1b31e08: Status 404 returned error can't find the container with id 4b769b43c478a075875e20df4fc7f13df70902c4fea02bda34662b08a1b31e08 May 21 18:13:53.738842 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.738615 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56921e05_de60_4edd_9ec7_26b8855265f0.slice/crio-eadd1dc0e3c8f1dda10266ca905fc806760fdb878954fd0459fe5c6a87b94ea4 WatchSource:0}: Error finding container eadd1dc0e3c8f1dda10266ca905fc806760fdb878954fd0459fe5c6a87b94ea4: Status 404 returned error can't find the container with id eadd1dc0e3c8f1dda10266ca905fc806760fdb878954fd0459fe5c6a87b94ea4 May 21 18:13:53.739896 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.739876 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde02aac3_fecd_4d58_bc01_3cf604065216.slice/crio-b65730c84a67329e0d22019cf04ab1e5fbeb90c99efdf69519ffadd5bb798255 WatchSource:0}: Error finding container b65730c84a67329e0d22019cf04ab1e5fbeb90c99efdf69519ffadd5bb798255: Status 404 returned error can't find the container with id b65730c84a67329e0d22019cf04ab1e5fbeb90c99efdf69519ffadd5bb798255 May 21 18:13:53.740450 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.740409 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0e470d_d4b0_49a8_877b_082639da824c.slice/crio-7d3fe6325944d589eb04e80145154196b5335e251648d0902fe35f9b5d615b4b WatchSource:0}: Error finding container 7d3fe6325944d589eb04e80145154196b5335e251648d0902fe35f9b5d615b4b: Status 404 returned error can't find the container with id 7d3fe6325944d589eb04e80145154196b5335e251648d0902fe35f9b5d615b4b May 21 18:13:53.741372 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.741336 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3737356_a09a_41d6_9bcb_c43b95694bdd.slice/crio-70f61418c3b9eb37f63598fe4623440786cbaf852b9dca523be1286bc6f877b3 WatchSource:0}: Error finding container 70f61418c3b9eb37f63598fe4623440786cbaf852b9dca523be1286bc6f877b3: Status 404 returned error can't find the container with id 70f61418c3b9eb37f63598fe4623440786cbaf852b9dca523be1286bc6f877b3 May 21 18:13:53.742281 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:13:53.742258 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6673235_c26d_44ce_bb74_415390b94b13.slice/crio-54eed53a8d02a9fb33d527bf089cb3fa0abda9c9a24e5083caf2dbb2f6168a10 WatchSource:0}: Error finding container 54eed53a8d02a9fb33d527bf089cb3fa0abda9c9a24e5083caf2dbb2f6168a10: Status 404 returned error can't find the container with id 54eed53a8d02a9fb33d527bf089cb3fa0abda9c9a24e5083caf2dbb2f6168a10 May 21 18:13:53.927925 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.927703 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:08:51 +0000 UTC" deadline="2028-02-10 01:27:48.134615278 +0000 UTC" May 21 18:13:53.927925 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:53.927921 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15103h13m54.20669941s" May 21 18:13:54.017175 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.017070 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:54.017175 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.017070 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:54.017389 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:54.017208 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:13:54.017389 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:54.017318 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:13:54.023015 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.022984 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdm4l" event={"ID":"56921e05-de60-4edd-9ec7-26b8855265f0","Type":"ContainerStarted","Data":"eadd1dc0e3c8f1dda10266ca905fc806760fdb878954fd0459fe5c6a87b94ea4"} May 21 18:13:54.023869 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.023851 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hrv95" event={"ID":"5493a7d9-c08d-4fdb-9917-ee56c14088ce","Type":"ContainerStarted","Data":"4b769b43c478a075875e20df4fc7f13df70902c4fea02bda34662b08a1b31e08"} May 21 18:13:54.024721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.024700 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jl9vw" event={"ID":"a8bfa48b-d2e0-4202-a074-f0dfff223c4a","Type":"ContainerStarted","Data":"50728a2f76a700afe6bc53453fb54e3d43d1a05502846ad6cab805241bb56e49"} May 21 18:13:54.025599 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.025578 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lt56c" event={"ID":"f2794223-39cf-49e2-a1d6-2d646f51b7a3","Type":"ContainerStarted","Data":"c569fb953a10611bf4f000d0c74b845897d10e249adbfbc26176789cb542a430"} May 21 18:13:54.026906 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.026880 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" event={"ID":"17c8340ff36fd99f490f39bff53685ee","Type":"ContainerStarted","Data":"229cdc23e1f83be91e90b5f7c5562d80650692d517a9ab19f0b880ccd10b887b"} May 21 18:13:54.027885 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.027864 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" event={"ID":"f3737356-a09a-41d6-9bcb-c43b95694bdd","Type":"ContainerStarted","Data":"70f61418c3b9eb37f63598fe4623440786cbaf852b9dca523be1286bc6f877b3"} May 21 18:13:54.029007 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.028988 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"b65730c84a67329e0d22019cf04ab1e5fbeb90c99efdf69519ffadd5bb798255"} May 21 18:13:54.030007 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.029979 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hknvb" event={"ID":"d9aa3f64-29a9-4f73-9583-7c66d32d62f6","Type":"ContainerStarted","Data":"cf4efff6981b2cfa05945863b9358d9a6eea2935d82b849ce1d772fcdbae53d9"} May 21 18:13:54.031027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.031007 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-62l8t" event={"ID":"f6673235-c26d-44ce-bb74-415390b94b13","Type":"ContainerStarted","Data":"54eed53a8d02a9fb33d527bf089cb3fa0abda9c9a24e5083caf2dbb2f6168a10"} May 21 18:13:54.032073 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.032049 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j82jz" event={"ID":"3d0e470d-d4b0-49a8-877b-082639da824c","Type":"ContainerStarted","Data":"7d3fe6325944d589eb04e80145154196b5335e251648d0902fe35f9b5d615b4b"} May 21 18:13:54.502271 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.502232 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:54.502457 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:54.502418 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:54.502524 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:54.502501 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs podName:4e102289-f8a8-475e-8f4e-422e0a01eed3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:56.502475907 +0000 UTC m=+6.066567159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs") pod "network-metrics-daemon-b8mgd" (UID: "4e102289-f8a8-475e-8f4e-422e0a01eed3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:54.603268 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:54.603223 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:54.603561 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:54.603511 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:54.603561 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:54.603536 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:54.603561 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:54.603549 2555 projected.go:194] Error preparing data for projected volume kube-api-access-br5hb for pod openshift-network-diagnostics/network-check-target-xj4l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:54.603835 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:54.603613 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb podName:f8bb9116-e94b-48be-9490-f716b72a291e nodeName:}" failed. No retries permitted until 2026-05-21 18:13:56.603594111 +0000 UTC m=+6.167685369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-br5hb" (UniqueName: "kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb") pod "network-check-target-xj4l2" (UID: "f8bb9116-e94b-48be-9490-f716b72a291e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:55.061725 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:55.061687 2555 generic.go:358] "Generic (PLEG): container finished" podID="a1196ce77df638362ef94db162acdbf1" containerID="2fcb1249c899586250186879181975e98c8cc8645c834cf9125da393c0ebfad0" exitCode=0 May 21 18:13:55.062260 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:55.062156 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" event={"ID":"a1196ce77df638362ef94db162acdbf1","Type":"ContainerDied","Data":"2fcb1249c899586250186879181975e98c8cc8645c834cf9125da393c0ebfad0"} May 21 18:13:55.079974 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:55.079917 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-244.ec2.internal" podStartSLOduration=3.079891182 podStartE2EDuration="3.079891182s" podCreationTimestamp="2026-05-21 18:13:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:13:54.039297498 +0000 UTC m=+3.603388760" watchObservedRunningTime="2026-05-21 18:13:55.079891182 +0000 UTC m=+4.643982446" May 21 18:13:56.017282 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:56.017252 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:56.017493 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:56.017369 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:13:56.017834 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:56.017811 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:56.017954 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:56.017918 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:13:56.073931 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:56.073891 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" event={"ID":"a1196ce77df638362ef94db162acdbf1","Type":"ContainerStarted","Data":"4748b635dcdee4c40118582b6422f303f82bb3bf3b5a235ab651655a721802fd"} May 21 18:13:56.091731 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:56.091676 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-244.ec2.internal" podStartSLOduration=4.091647333 podStartE2EDuration="4.091647333s" podCreationTimestamp="2026-05-21 18:13:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:13:56.091012816 +0000 UTC m=+5.655104078" watchObservedRunningTime="2026-05-21 18:13:56.091647333 +0000 UTC m=+5.655738597" May 21 18:13:56.521748 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:56.521190 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:56.521748 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:56.521333 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:56.521748 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:56.521411 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs podName:4e102289-f8a8-475e-8f4e-422e0a01eed3 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:00.521389733 +0000 UTC m=+10.085480991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs") pod "network-metrics-daemon-b8mgd" (UID: "4e102289-f8a8-475e-8f4e-422e0a01eed3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:56.622214 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:56.621577 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:56.622214 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:56.621746 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:56.622214 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:56.621763 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:56.622214 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:56.621776 2555 projected.go:194] Error preparing data for projected volume kube-api-access-br5hb for pod openshift-network-diagnostics/network-check-target-xj4l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:56.622214 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:56.621837 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb podName:f8bb9116-e94b-48be-9490-f716b72a291e nodeName:}" failed. No retries permitted until 2026-05-21 18:14:00.621817672 +0000 UTC m=+10.185908932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-br5hb" (UniqueName: "kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb") pod "network-check-target-xj4l2" (UID: "f8bb9116-e94b-48be-9490-f716b72a291e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:58.016608 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:58.016574 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:13:58.017062 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:58.016705 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:13:58.017292 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:13:58.017269 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:13:58.017438 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:13:58.017417 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:00.016731 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:00.016663 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:00.017219 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:00.016663 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:00.017219 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:00.016807 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:00.017219 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:00.016869 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:00.553038 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:00.552926 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:00.553242 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:00.553090 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:14:00.553242 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:00.553178 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs podName:4e102289-f8a8-475e-8f4e-422e0a01eed3 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:08.553157033 +0000 UTC m=+18.117248286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs") pod "network-metrics-daemon-b8mgd" (UID: "4e102289-f8a8-475e-8f4e-422e0a01eed3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:14:00.654218 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:00.654177 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:00.654385 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:00.654331 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:14:00.654385 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:00.654348 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:14:00.654385 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:00.654360 2555 projected.go:194] Error preparing data for projected volume kube-api-access-br5hb for pod openshift-network-diagnostics/network-check-target-xj4l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:14:00.654555 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:00.654413 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb podName:f8bb9116-e94b-48be-9490-f716b72a291e nodeName:}" failed. No retries permitted until 2026-05-21 18:14:08.65440048 +0000 UTC m=+18.218491720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-br5hb" (UniqueName: "kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb") pod "network-check-target-xj4l2" (UID: "f8bb9116-e94b-48be-9490-f716b72a291e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:14:02.016646 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:02.016603 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:02.017099 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:02.016748 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:02.017199 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:02.017174 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:02.017318 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:02.017280 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:04.016481 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.016242 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:04.016982 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.016359 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:04.016982 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:04.016587 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:04.016982 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:04.016672 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:04.089671 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.089586 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jl9vw" event={"ID":"a8bfa48b-d2e0-4202-a074-f0dfff223c4a","Type":"ContainerStarted","Data":"56063fa4d79670ea892628c9d0331cc628040d5cc60e7a5dd6341658f233c304"} May 21 18:14:04.091201 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.091167 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" event={"ID":"f3737356-a09a-41d6-9bcb-c43b95694bdd","Type":"ContainerStarted","Data":"3d8def5a2f34350151baa4fadcb18bfa595ef368b37cca9b4194eb3b53950861"} May 21 18:14:04.093502 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.093460 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hknvb" event={"ID":"d9aa3f64-29a9-4f73-9583-7c66d32d62f6","Type":"ContainerStarted","Data":"d1dee4428bbf9c09b7a6720e1d16f2ecd63e89a47cd678a99965f72167066217"} May 21 18:14:04.097295 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.097270 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-62l8t" event={"ID":"f6673235-c26d-44ce-bb74-415390b94b13","Type":"ContainerStarted","Data":"8eb31b0de6da46be419ad00e3e8a520d9b9211287be6ffd6fca1bdafdfb02a23"} May 21 18:14:04.098781 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.098756 2555 generic.go:358] "Generic (PLEG): container finished" podID="3d0e470d-d4b0-49a8-877b-082639da824c" containerID="d772caf4e5d05a5156ab315285f78360af408786c3b7e16e128dc2f105e39757" exitCode=0 May 21 18:14:04.098886 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.098821 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j82jz" event={"ID":"3d0e470d-d4b0-49a8-877b-082639da824c","Type":"ContainerDied","Data":"d772caf4e5d05a5156ab315285f78360af408786c3b7e16e128dc2f105e39757"} May 21 18:14:04.100586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.100380 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hrv95" event={"ID":"5493a7d9-c08d-4fdb-9917-ee56c14088ce","Type":"ContainerStarted","Data":"f634a307c0913d50aa17443140e93688f35a823d2cbd08d32e55cca591971d87"} May 21 18:14:04.104029 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.103971 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jl9vw" podStartSLOduration=3.72189724 podStartE2EDuration="13.10395451s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.739184196 +0000 UTC m=+3.303275436" lastFinishedPulling="2026-05-21 18:14:03.121241466 +0000 UTC m=+12.685332706" observedRunningTime="2026-05-21 18:14:04.103315471 +0000 UTC m=+13.667406745" watchObservedRunningTime="2026-05-21 18:14:04.10395451 +0000 UTC m=+13.668045779" May 21 18:14:04.115917 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.115860 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hrv95" podStartSLOduration=3.763636146 podStartE2EDuration="13.115842776s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.739692575 +0000 UTC m=+3.303783828" lastFinishedPulling="2026-05-21 18:14:03.091899206 +0000 UTC m=+12.655990458" observedRunningTime="2026-05-21 18:14:04.11564109 +0000 UTC m=+13.679732345" watchObservedRunningTime="2026-05-21 18:14:04.115842776 +0000 UTC m=+13.679934038" May 21 18:14:04.128792 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.128740 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-62l8t" podStartSLOduration=3.785451578 podStartE2EDuration="13.128719735s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.744346781 +0000 UTC m=+3.308438021" lastFinishedPulling="2026-05-21 18:14:03.087614936 +0000 UTC m=+12.651706178" observedRunningTime="2026-05-21 18:14:04.127922371 +0000 UTC m=+13.692013634" watchObservedRunningTime="2026-05-21 18:14:04.128719735 +0000 UTC m=+13.692811007" May 21 18:14:04.162683 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:04.162635 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hknvb" podStartSLOduration=3.736685724 podStartE2EDuration="13.162620434s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.735829112 +0000 UTC m=+3.299920351" lastFinishedPulling="2026-05-21 18:14:03.161763808 +0000 UTC m=+12.725855061" observedRunningTime="2026-05-21 18:14:04.142801849 +0000 UTC m=+13.706893123" watchObservedRunningTime="2026-05-21 18:14:04.162620434 +0000 UTC m=+13.726711694" May 21 18:14:05.104007 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:05.103969 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lt56c" event={"ID":"f2794223-39cf-49e2-a1d6-2d646f51b7a3","Type":"ContainerStarted","Data":"9bd390028b33bcaba0ac17092e55d4b430402cb7460d635c5cac91f84421d680"} May 21 18:14:06.016631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:06.016592 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:06.016790 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:06.016595 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:06.016790 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:06.016720 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:06.016912 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:06.016802 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:06.988314 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:06.988273 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-62l8t" May 21 18:14:06.988994 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:06.988964 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-62l8t" May 21 18:14:07.002422 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:07.002372 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lt56c" podStartSLOduration=6.640706924 podStartE2EDuration="16.002358618s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.730604376 +0000 UTC m=+3.294695616" lastFinishedPulling="2026-05-21 18:14:03.092256058 +0000 UTC m=+12.656347310" observedRunningTime="2026-05-21 18:14:05.118061186 +0000 UTC m=+14.682152452" watchObservedRunningTime="2026-05-21 18:14:07.002358618 +0000 UTC m=+16.566449882" May 21 18:14:07.107533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:07.107506 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-62l8t" May 21 18:14:07.108056 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:07.108038 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-62l8t" May 21 18:14:08.016416 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:08.016384 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:08.017080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:08.016384 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:08.017080 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:08.016523 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:08.017080 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:08.016575 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:08.619061 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:08.619027 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:08.619251 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:08.619192 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:14:08.619310 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:08.619258 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs podName:4e102289-f8a8-475e-8f4e-422e0a01eed3 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:24.619242367 +0000 UTC m=+34.183333607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs") pod "network-metrics-daemon-b8mgd" (UID: "4e102289-f8a8-475e-8f4e-422e0a01eed3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:14:08.720441 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:08.720401 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:08.720618 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:08.720584 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:14:08.720618 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:08.720606 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:14:08.720728 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:08.720621 2555 projected.go:194] Error preparing data for projected volume kube-api-access-br5hb for pod openshift-network-diagnostics/network-check-target-xj4l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:14:08.720728 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:08.720702 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb podName:f8bb9116-e94b-48be-9490-f716b72a291e nodeName:}" failed. No retries permitted until 2026-05-21 18:14:24.720682694 +0000 UTC m=+34.284773948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-br5hb" (UniqueName: "kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb") pod "network-check-target-xj4l2" (UID: "f8bb9116-e94b-48be-9490-f716b72a291e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:14:10.016555 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:10.016517 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:10.016555 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:10.016543 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:10.017044 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:10.016656 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:10.017044 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:10.016772 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:12.016254 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:12.016219 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:12.016254 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:12.016213 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:12.016690 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:12.016327 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:12.016690 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:12.016458 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:14.016794 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:14.016591 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:14.017352 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:14.016592 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:14.017352 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:14.016883 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:14.017352 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:14.016967 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:14.221572 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:14.221531 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 18:14:14.953247 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:14.952954 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T18:14:14.221553405Z","UUID":"6f451512-820e-44f3-8061-b478234813b3","Handler":null,"Name":"","Endpoint":""} May 21 18:14:14.955545 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:14.955518 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 18:14:14.955664 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:14.955554 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 18:14:15.122894 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.122864 2555 generic.go:358] "Generic (PLEG): container finished" podID="3d0e470d-d4b0-49a8-877b-082639da824c" containerID="9e896df22df3a3f732a904e7d8c1f70a06fece2274a924bd4af3deb871674420" exitCode=0 May 21 18:14:15.123451 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.122927 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j82jz" event={"ID":"3d0e470d-d4b0-49a8-877b-082639da824c","Type":"ContainerDied","Data":"9e896df22df3a3f732a904e7d8c1f70a06fece2274a924bd4af3deb871674420"} May 21 18:14:15.124166 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.124139 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdm4l" event={"ID":"56921e05-de60-4edd-9ec7-26b8855265f0","Type":"ContainerStarted","Data":"edba33e91b754c6d70151d7fed18a521da315cf9905def28fa98a3f35573a501"} May 21 18:14:15.125677 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.125647 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" event={"ID":"f3737356-a09a-41d6-9bcb-c43b95694bdd","Type":"ContainerStarted","Data":"6d21992e7deba6346fad69738f4abad9959f67e2809b799ab0c107fe6f2399e2"} May 21 18:14:15.127883 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.127863 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"947f15b6416ead5c391dc1f65ddd7f728aee7a06cb2c0e1622b9a40b2e781567"} May 21 18:14:15.127951 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.127888 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"f20e7411ccfd3ab4f4118e1d15c9ea0ee92e935d0d5b5c5dfcafef2e21299be8"} May 21 18:14:15.127951 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.127896 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"0aac6634a60814d75aa0e41fae644e6fa529d01fff2973c4c1e1961e6db24ba9"} May 21 18:14:15.127951 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.127904 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"fc4c3a6591686b095273e4f288c0c18ba9a03d2ce114e1ccdf5762733ae2758e"} May 21 18:14:15.127951 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.127912 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"6b80030759371fce3aad9cc8c77a311b1f0bf9dc3ed7d5287a28a96b9f3ae4c3"} May 21 18:14:15.127951 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.127919 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"1a20d605038790197b496be8a9e329d407284705b97074fab833207317511bfc"} May 21 18:14:15.159345 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:15.159300 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-cdm4l" podStartSLOduration=5.318116446 podStartE2EDuration="24.15928767s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.740589858 +0000 UTC m=+3.304681099" lastFinishedPulling="2026-05-21 18:14:12.581761085 +0000 UTC m=+22.145852323" observedRunningTime="2026-05-21 18:14:15.158722473 +0000 UTC m=+24.722813734" watchObservedRunningTime="2026-05-21 18:14:15.15928767 +0000 UTC m=+24.723378931" May 21 18:14:16.016399 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:16.016361 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:16.016562 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:16.016361 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:16.016562 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:16.016480 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:16.016632 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:16.016576 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:16.131343 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:16.131305 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" event={"ID":"f3737356-a09a-41d6-9bcb-c43b95694bdd","Type":"ContainerStarted","Data":"31fe55d613c61bf5dd6d06e8d3dd03d45d1d022a88cd9bb75cbe2c3c3142c7e4"} May 21 18:14:16.146874 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:16.146832 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g298" podStartSLOduration=3.513447107 podStartE2EDuration="25.146817644s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.744065898 +0000 UTC m=+3.308157139" lastFinishedPulling="2026-05-21 18:14:15.377436423 +0000 UTC m=+24.941527676" observedRunningTime="2026-05-21 18:14:16.14658513 +0000 UTC m=+25.710676401" watchObservedRunningTime="2026-05-21 18:14:16.146817644 +0000 UTC m=+25.710908904" May 21 18:14:17.135678 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:17.135639 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"97ec4ad7d4ee4ca1564c45a139ab76980e2f756f1ac4c71093d2b3e078cdd6e0"} May 21 18:14:17.137342 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:17.137316 2555 generic.go:358] "Generic (PLEG): container finished" podID="3d0e470d-d4b0-49a8-877b-082639da824c" containerID="c689bc96b2e31ab1df43149d17bf7e889c5a1316e30bb7191b0836ec7580deed" exitCode=0 May 21 18:14:17.137462 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:17.137397 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j82jz" event={"ID":"3d0e470d-d4b0-49a8-877b-082639da824c","Type":"ContainerDied","Data":"c689bc96b2e31ab1df43149d17bf7e889c5a1316e30bb7191b0836ec7580deed"} May 21 18:14:18.017176 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:18.017142 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:18.017319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:18.017145 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:18.017319 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:18.017241 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:18.017399 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:18.017313 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:19.142948 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.142619 2555 generic.go:358] "Generic (PLEG): container finished" podID="3d0e470d-d4b0-49a8-877b-082639da824c" containerID="4fac9aae46bdbbd8637cf05db28dc1bb9976d5e3a6601e5fa0fe8ea9d219ad71" exitCode=0 May 21 18:14:19.142948 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.142704 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j82jz" event={"ID":"3d0e470d-d4b0-49a8-877b-082639da824c","Type":"ContainerDied","Data":"4fac9aae46bdbbd8637cf05db28dc1bb9976d5e3a6601e5fa0fe8ea9d219ad71"} May 21 18:14:19.146575 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.146551 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" event={"ID":"de02aac3-fecd-4d58-bc01-3cf604065216","Type":"ContainerStarted","Data":"5c843bd69ebd3bb775986f47e25cd6b45b0e962e4eb025a5cfa6c75498b3ac0d"} May 21 18:14:19.146763 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.146750 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:14:19.146857 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.146770 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:14:19.146929 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.146892 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:14:19.162314 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.162286 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:14:19.162476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.162461 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:14:19.189625 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:19.189581 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" podStartSLOduration=7.822574293 podStartE2EDuration="28.189568197s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.741617478 +0000 UTC m=+3.305708722" lastFinishedPulling="2026-05-21 18:14:14.108611378 +0000 UTC m=+23.672702626" observedRunningTime="2026-05-21 18:14:19.188526245 +0000 UTC m=+28.752617508" watchObservedRunningTime="2026-05-21 18:14:19.189568197 +0000 UTC m=+28.753659488" May 21 18:14:20.016952 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:20.016917 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:20.017147 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:20.016928 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:20.017147 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:20.017038 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:20.017147 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:20.017119 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:20.817178 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:20.816777 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xj4l2"] May 21 18:14:20.817178 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:20.816910 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:20.817178 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:20.817010 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:20.817713 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:20.817462 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b8mgd"] May 21 18:14:20.817713 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:20.817575 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:20.817713 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:20.817680 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:23.016835 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:23.016796 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:23.017255 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:23.016845 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:23.017255 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:23.016950 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:23.017255 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:23.017090 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:24.639932 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:24.639882 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:24.640509 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:24.640052 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:14:24.640509 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:24.640132 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs podName:4e102289-f8a8-475e-8f4e-422e0a01eed3 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:56.640099546 +0000 UTC m=+66.204190794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs") pod "network-metrics-daemon-b8mgd" (UID: "4e102289-f8a8-475e-8f4e-422e0a01eed3") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:14:24.740870 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:24.740813 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:24.741048 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:24.741011 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:14:24.741048 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:24.741040 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:14:24.741160 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:24.741054 2555 projected.go:194] Error preparing data for projected volume kube-api-access-br5hb for pod openshift-network-diagnostics/network-check-target-xj4l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:14:24.741160 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:24.741135 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb podName:f8bb9116-e94b-48be-9490-f716b72a291e nodeName:}" failed. No retries permitted until 2026-05-21 18:14:56.741101483 +0000 UTC m=+66.305192725 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-br5hb" (UniqueName: "kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb") pod "network-check-target-xj4l2" (UID: "f8bb9116-e94b-48be-9490-f716b72a291e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:14:25.016839 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:25.016811 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:25.016997 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:25.016820 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:25.016997 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:25.016912 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:25.017079 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:25.017004 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:26.165144 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:26.164957 2555 generic.go:358] "Generic (PLEG): container finished" podID="3d0e470d-d4b0-49a8-877b-082639da824c" containerID="5a9ab9a837a10941b316c4c8978b9d4f9900c122170ad5d5757a1ecd18118c78" exitCode=0 May 21 18:14:26.165144 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:26.165043 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j82jz" event={"ID":"3d0e470d-d4b0-49a8-877b-082639da824c","Type":"ContainerDied","Data":"5a9ab9a837a10941b316c4c8978b9d4f9900c122170ad5d5757a1ecd18118c78"} May 21 18:14:27.017314 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.017285 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:27.017485 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.017289 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:27.017485 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:27.017401 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8mgd" podUID="4e102289-f8a8-475e-8f4e-422e0a01eed3" May 21 18:14:27.017579 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:27.017481 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4l2" podUID="f8bb9116-e94b-48be-9490-f716b72a291e" May 21 18:14:27.172247 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.172210 2555 generic.go:358] "Generic (PLEG): container finished" podID="3d0e470d-d4b0-49a8-877b-082639da824c" containerID="b24bb0e4db41a6466e9d1042bfd360297a047dfe1c810d6d98074ce38432d8a0" exitCode=0 May 21 18:14:27.172755 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.172260 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j82jz" event={"ID":"3d0e470d-d4b0-49a8-877b-082639da824c","Type":"ContainerDied","Data":"b24bb0e4db41a6466e9d1042bfd360297a047dfe1c810d6d98074ce38432d8a0"} May 21 18:14:27.745769 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.745744 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-244.ec2.internal" event="NodeReady" May 21 18:14:27.745937 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.745863 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 18:14:27.789703 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.789670 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ml5nd"] May 21 18:14:27.803194 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.803164 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rqs4r"] May 21 18:14:27.803502 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.803475 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ml5nd" May 21 18:14:27.805948 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.805926 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 18:14:27.806077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.805957 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 18:14:27.806077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.806018 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8zgcw\"" May 21 18:14:27.813165 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.813145 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ml5nd"] May 21 18:14:27.813271 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.813169 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqs4r"] May 21 18:14:27.813271 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.813258 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:27.815386 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.815367 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 18:14:27.815504 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.815400 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 18:14:27.815504 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.815465 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xmgqj\"" May 21 18:14:27.815680 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.815668 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 18:14:27.963279 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.963245 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:27.963279 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.963294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:27.963491 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.963327 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nf6h\" (UniqueName: \"kubernetes.io/projected/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-kube-api-access-6nf6h\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:27.963491 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.963366 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qr4t\" (UniqueName: \"kubernetes.io/projected/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-kube-api-access-6qr4t\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:27.963491 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.963386 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-config-volume\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:27.963491 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:27.963439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-tmp-dir\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.064777 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.064689 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-tmp-dir\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.064777 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.064744 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:28.064777 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.064771 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.064975 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:28.064869 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:28.064975 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.064873 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6nf6h\" (UniqueName: \"kubernetes.io/projected/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-kube-api-access-6nf6h\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:28.064975 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:28.064919 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls podName:c054bab1-a1e6-4166-afe9-c02f7cf4a0bd nodeName:}" failed. No retries permitted until 2026-05-21 18:14:28.564906914 +0000 UTC m=+38.128998153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls") pod "dns-default-ml5nd" (UID: "c054bab1-a1e6-4166-afe9-c02f7cf4a0bd") : secret "dns-default-metrics-tls" not found May 21 18:14:28.064975 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:28.064869 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:28.065099 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:28.065001 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert podName:0e84d92d-02a2-436b-a0dd-92d3d7891a7b nodeName:}" failed. No retries permitted until 2026-05-21 18:14:28.564979985 +0000 UTC m=+38.129071241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert") pod "ingress-canary-rqs4r" (UID: "0e84d92d-02a2-436b-a0dd-92d3d7891a7b") : secret "canary-serving-cert" not found May 21 18:14:28.065099 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.064936 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qr4t\" (UniqueName: \"kubernetes.io/projected/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-kube-api-access-6qr4t\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.065099 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.065056 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-config-volume\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.065099 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.065078 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-tmp-dir\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.065518 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.065500 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-config-volume\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.075698 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.075670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qr4t\" (UniqueName: \"kubernetes.io/projected/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-kube-api-access-6qr4t\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.075801 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.075678 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nf6h\" (UniqueName: \"kubernetes.io/projected/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-kube-api-access-6nf6h\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:28.177486 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.177455 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j82jz" event={"ID":"3d0e470d-d4b0-49a8-877b-082639da824c","Type":"ContainerStarted","Data":"129fe4c8ff49a194b476307618552038b961a24dc5883693f179bbf47ddd7c73"} May 21 18:14:28.197051 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.197011 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j82jz" podStartSLOduration=5.668007544 podStartE2EDuration="37.196997575s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:53.742827189 +0000 UTC m=+3.306918428" lastFinishedPulling="2026-05-21 18:14:25.271817217 +0000 UTC m=+34.835908459" observedRunningTime="2026-05-21 18:14:28.196286138 +0000 UTC m=+37.760377399" watchObservedRunningTime="2026-05-21 18:14:28.196997575 +0000 UTC m=+37.761088813" May 21 18:14:28.568836 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.568804 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:28.568980 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:28.568847 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:28.568980 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:28.568953 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:28.569048 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:28.569012 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert podName:0e84d92d-02a2-436b-a0dd-92d3d7891a7b nodeName:}" failed. No retries permitted until 2026-05-21 18:14:29.568998413 +0000 UTC m=+39.133089656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert") pod "ingress-canary-rqs4r" (UID: "0e84d92d-02a2-436b-a0dd-92d3d7891a7b") : secret "canary-serving-cert" not found May 21 18:14:28.569048 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:28.568953 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:28.569138 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:28.569095 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls podName:c054bab1-a1e6-4166-afe9-c02f7cf4a0bd nodeName:}" failed. No retries permitted until 2026-05-21 18:14:29.569067676 +0000 UTC m=+39.133158932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls") pod "dns-default-ml5nd" (UID: "c054bab1-a1e6-4166-afe9-c02f7cf4a0bd") : secret "dns-default-metrics-tls" not found May 21 18:14:29.016361 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.016331 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:29.016490 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.016330 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:29.021606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.021468 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 18:14:29.021606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.021481 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w9qjh\"" May 21 18:14:29.021606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.021482 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 18:14:29.021606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.021508 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tccs\"" May 21 18:14:29.021606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.021481 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 18:14:29.576566 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.576530 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:29.576921 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:29.576573 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:29.576921 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:29.576676 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:29.576921 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:29.576738 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert podName:0e84d92d-02a2-436b-a0dd-92d3d7891a7b nodeName:}" failed. No retries permitted until 2026-05-21 18:14:31.576724492 +0000 UTC m=+41.140815734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert") pod "ingress-canary-rqs4r" (UID: "0e84d92d-02a2-436b-a0dd-92d3d7891a7b") : secret "canary-serving-cert" not found May 21 18:14:29.576921 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:29.576676 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:29.576921 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:29.576801 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls podName:c054bab1-a1e6-4166-afe9-c02f7cf4a0bd nodeName:}" failed. No retries permitted until 2026-05-21 18:14:31.576790616 +0000 UTC m=+41.140881855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls") pod "dns-default-ml5nd" (UID: "c054bab1-a1e6-4166-afe9-c02f7cf4a0bd") : secret "dns-default-metrics-tls" not found May 21 18:14:31.589309 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:31.589269 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:31.589309 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:31.589310 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:31.589710 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:31.589411 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:31.589710 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:31.589418 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:31.589710 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:31.589463 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls podName:c054bab1-a1e6-4166-afe9-c02f7cf4a0bd nodeName:}" failed. No retries permitted until 2026-05-21 18:14:35.58944911 +0000 UTC m=+45.153540349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls") pod "dns-default-ml5nd" (UID: "c054bab1-a1e6-4166-afe9-c02f7cf4a0bd") : secret "dns-default-metrics-tls" not found May 21 18:14:31.589710 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:31.589476 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert podName:0e84d92d-02a2-436b-a0dd-92d3d7891a7b nodeName:}" failed. No retries permitted until 2026-05-21 18:14:35.589470407 +0000 UTC m=+45.153561647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert") pod "ingress-canary-rqs4r" (UID: "0e84d92d-02a2-436b-a0dd-92d3d7891a7b") : secret "canary-serving-cert" not found May 21 18:14:35.616985 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:35.616942 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:35.617474 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:35.616998 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:35.617474 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:35.617096 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:35.617474 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:35.617130 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:35.617474 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:35.617180 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert podName:0e84d92d-02a2-436b-a0dd-92d3d7891a7b nodeName:}" failed. No retries permitted until 2026-05-21 18:14:43.617165059 +0000 UTC m=+53.181256303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert") pod "ingress-canary-rqs4r" (UID: "0e84d92d-02a2-436b-a0dd-92d3d7891a7b") : secret "canary-serving-cert" not found May 21 18:14:35.617474 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:35.617197 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls podName:c054bab1-a1e6-4166-afe9-c02f7cf4a0bd nodeName:}" failed. No retries permitted until 2026-05-21 18:14:43.617190092 +0000 UTC m=+53.181281331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls") pod "dns-default-ml5nd" (UID: "c054bab1-a1e6-4166-afe9-c02f7cf4a0bd") : secret "dns-default-metrics-tls" not found May 21 18:14:43.669876 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:43.669689 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:43.670413 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:43.669891 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:43.670413 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:43.669845 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:43.670413 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:43.669969 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:43.670413 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:43.670012 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls podName:c054bab1-a1e6-4166-afe9-c02f7cf4a0bd nodeName:}" failed. No retries permitted until 2026-05-21 18:14:59.669998091 +0000 UTC m=+69.234089329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls") pod "dns-default-ml5nd" (UID: "c054bab1-a1e6-4166-afe9-c02f7cf4a0bd") : secret "dns-default-metrics-tls" not found May 21 18:14:43.670413 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:43.670026 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert podName:0e84d92d-02a2-436b-a0dd-92d3d7891a7b nodeName:}" failed. No retries permitted until 2026-05-21 18:14:59.670019088 +0000 UTC m=+69.234110327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert") pod "ingress-canary-rqs4r" (UID: "0e84d92d-02a2-436b-a0dd-92d3d7891a7b") : secret "canary-serving-cert" not found May 21 18:14:51.165194 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:51.165157 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76cmd" May 21 18:14:56.658590 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:56.658544 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:14:56.661373 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:56.661353 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 18:14:56.669267 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:56.669247 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 18:14:56.669330 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:56.669319 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs podName:4e102289-f8a8-475e-8f4e-422e0a01eed3 nodeName:}" failed. No retries permitted until 2026-05-21 18:16:00.669295315 +0000 UTC m=+130.233386556 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs") pod "network-metrics-daemon-b8mgd" (UID: "4e102289-f8a8-475e-8f4e-422e0a01eed3") : secret "metrics-daemon-secret" not found May 21 18:14:56.759033 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:56.758994 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:56.761717 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:56.761699 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 18:14:56.771821 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:56.771803 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 18:14:56.783385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:56.783361 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br5hb\" (UniqueName: \"kubernetes.io/projected/f8bb9116-e94b-48be-9490-f716b72a291e-kube-api-access-br5hb\") pod \"network-check-target-xj4l2\" (UID: \"f8bb9116-e94b-48be-9490-f716b72a291e\") " pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:56.936955 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:56.936877 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w9qjh\"" May 21 18:14:56.945084 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:56.945060 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:14:57.073629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:57.073589 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xj4l2"] May 21 18:14:57.076709 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:14:57.076672 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bb9116_e94b_48be_9490_f716b72a291e.slice/crio-d2782b4c0a133609cebe4b8f42b8ee81950b813611530cab000b027f40dde118 WatchSource:0}: Error finding container d2782b4c0a133609cebe4b8f42b8ee81950b813611530cab000b027f40dde118: Status 404 returned error can't find the container with id d2782b4c0a133609cebe4b8f42b8ee81950b813611530cab000b027f40dde118 May 21 18:14:57.233598 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:57.233559 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xj4l2" event={"ID":"f8bb9116-e94b-48be-9490-f716b72a291e","Type":"ContainerStarted","Data":"d2782b4c0a133609cebe4b8f42b8ee81950b813611530cab000b027f40dde118"} May 21 18:14:59.683677 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:59.683637 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:14:59.684192 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:14:59.683680 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:14:59.684192 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:59.683811 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:59.684192 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:59.683813 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:59.684192 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:59.683880 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls podName:c054bab1-a1e6-4166-afe9-c02f7cf4a0bd nodeName:}" failed. No retries permitted until 2026-05-21 18:15:31.683859612 +0000 UTC m=+101.247950855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls") pod "dns-default-ml5nd" (UID: "c054bab1-a1e6-4166-afe9-c02f7cf4a0bd") : secret "dns-default-metrics-tls" not found May 21 18:14:59.684192 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:14:59.683897 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert podName:0e84d92d-02a2-436b-a0dd-92d3d7891a7b nodeName:}" failed. No retries permitted until 2026-05-21 18:15:31.683888774 +0000 UTC m=+101.247980017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert") pod "ingress-canary-rqs4r" (UID: "0e84d92d-02a2-436b-a0dd-92d3d7891a7b") : secret "canary-serving-cert" not found May 21 18:15:01.242712 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:01.242677 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xj4l2" event={"ID":"f8bb9116-e94b-48be-9490-f716b72a291e","Type":"ContainerStarted","Data":"f7b21fd2deb655e45c9dd69593b441d7fdf9539e238948e067594b5743a12125"} May 21 18:15:01.243090 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:01.242820 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:15:01.257322 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:01.257273 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xj4l2" podStartSLOduration=66.631430681 podStartE2EDuration="1m10.257257956s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:14:57.078565002 +0000 UTC m=+66.642656243" lastFinishedPulling="2026-05-21 18:15:00.704392276 +0000 UTC m=+70.268483518" observedRunningTime="2026-05-21 18:15:01.255908074 +0000 UTC m=+70.819999335" watchObservedRunningTime="2026-05-21 18:15:01.257257956 +0000 UTC m=+70.821349214" May 21 18:15:27.990179 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:27.990047 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-4jwdp"] May 21 18:15:27.992856 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:27.992835 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:27.995206 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:27.995177 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wb4lf\"" May 21 18:15:27.995959 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:27.995939 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 18:15:27.996128 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:27.995991 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 18:15:27.996128 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:27.995991 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 18:15:27.996875 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:27.996859 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 18:15:28.004379 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.004358 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j"] May 21 18:15:28.009802 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.009780 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 18:15:28.010133 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.010101 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f"] May 21 18:15:28.010262 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.010247 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:28.011920 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.011901 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f4555f475-tqm5j"] May 21 18:15:28.012041 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.012025 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f" May 21 18:15:28.013814 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.013794 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-4jwdp"] May 21 18:15:28.013922 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.013895 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.015776 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.015758 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 18:15:28.016032 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.016012 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 18:15:28.016142 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.016010 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 18:15:28.016340 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.016325 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 18:15:28.016563 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.016545 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 18:15:28.016694 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.016677 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jlfqd\"" May 21 18:15:28.016869 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.016852 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j"] May 21 18:15:28.017170 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.017154 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sjddb\"" May 21 18:15:28.017263 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.017147 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pv58l\"" May 21 18:15:28.017431 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.017195 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 18:15:28.017552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.017535 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 18:15:28.017612 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.017597 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 18:15:28.024277 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.024259 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f"] May 21 18:15:28.025360 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.025334 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f4555f475-tqm5j"] May 21 18:15:28.026692 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.026669 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 18:15:28.076473 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076440 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-serving-cert\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.076629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjz24\" (UniqueName: \"kubernetes.io/projected/d21770a8-375b-4c87-a7f5-847d940072d1-kube-api-access-fjz24\") pod \"volume-data-source-validator-5cf8c89d64-6lj9f\" (UID: \"d21770a8-375b-4c87-a7f5-847d940072d1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f" May 21 18:15:28.076629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076510 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-installation-pull-secrets\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.076629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6ss8\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-kube-api-access-x6ss8\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.076629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-bound-sa-token\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.076629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076607 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-image-registry-private-configuration\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.076803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076630 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.076803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076676 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-config\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.076803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076697 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:28.076803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/698fb556-3195-4931-807b-2159a1630cc2-ca-trust-extracted\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.076803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjkpx\" (UniqueName: \"kubernetes.io/projected/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-kube-api-access-gjkpx\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.076803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076746 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj5zx\" (UniqueName: \"kubernetes.io/projected/f591a2be-5f0d-4146-aa73-b9a58ef2a894-kube-api-access-mj5zx\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:28.076803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076764 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-trusted-ca\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.077014 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076799 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-trusted-ca\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.077014 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.076848 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-registry-certificates\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.121819 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.121789 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp"] May 21 18:15:28.123893 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.123878 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.126828 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.126797 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 18:15:28.126924 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.126843 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 18:15:28.126924 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.126885 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fpkqt\"" May 21 18:15:28.127205 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.127191 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 18:15:28.127289 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.127226 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 18:15:28.131824 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.131806 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw"] May 21 18:15:28.134069 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.134051 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-spwhr"] May 21 18:15:28.134218 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.134196 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.136726 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.136703 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.140016 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.139997 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 18:15:28.140016 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.140004 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 18:15:28.140271 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.140248 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 18:15:28.140384 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.140282 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g4q67\"" May 21 18:15:28.140384 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.140250 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 18:15:28.140384 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.140250 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 18:15:28.140384 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.140322 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 18:15:28.141138 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.141122 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fjkpq\"" May 21 18:15:28.144953 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.144931 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 18:15:28.145060 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.144973 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 18:15:28.150926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.150907 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 18:15:28.152293 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.152272 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp"] May 21 18:15:28.153203 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.153186 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw"] May 21 18:15:28.154517 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.154500 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-spwhr"] May 21 18:15:28.177191 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-service-ca-bundle\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.177337 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177199 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-bound-sa-token\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.177337 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177220 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-image-registry-private-configuration\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.177337 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177242 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.177337 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.177313 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:15:28.177337 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.177324 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f4555f475-tqm5j: secret "image-registry-tls" not found May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177342 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-snapshots\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.177375 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls podName:698fb556-3195-4931-807b-2159a1630cc2 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:28.677361464 +0000 UTC m=+98.241452704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls") pod "image-registry-6f4555f475-tqm5j" (UID: "698fb556-3195-4931-807b-2159a1630cc2") : secret "image-registry-tls" not found May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gj2g\" (UniqueName: \"kubernetes.io/projected/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-kube-api-access-9gj2g\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177415 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177442 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjkpx\" (UniqueName: \"kubernetes.io/projected/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-kube-api-access-gjkpx\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177473 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-trusted-ca\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.177507 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.177560 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls podName:f591a2be-5f0d-4146-aa73-b9a58ef2a894 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:28.677548075 +0000 UTC m=+98.241639319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls") pod "cluster-samples-operator-697587599-z4m9j" (UID: "f591a2be-5f0d-4146-aa73-b9a58ef2a894") : secret "samples-operator-tls" not found May 21 18:15:28.177589 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177616 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-registry-certificates\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c35f900f-5f12-42bf-b03c-7648b91407e4-config\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177663 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-serving-cert\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177678 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-installation-pull-secrets\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af16bf09-0e98-4f24-9571-f94284be67ee-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177813 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6ss8\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-kube-api-access-x6ss8\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177854 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-serving-cert\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cwgf\" (UniqueName: \"kubernetes.io/projected/c35f900f-5f12-42bf-b03c-7648b91407e4-kube-api-access-7cwgf\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177952 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-config\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.177979 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/698fb556-3195-4931-807b-2159a1630cc2-ca-trust-extracted\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.178006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.178010 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mj5zx\" (UniqueName: \"kubernetes.io/projected/f591a2be-5f0d-4146-aa73-b9a58ef2a894-kube-api-access-mj5zx\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.178037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c35f900f-5f12-42bf-b03c-7648b91407e4-serving-cert\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.178095 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-trusted-ca\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.178141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-tmp\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.178184 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjz24\" (UniqueName: \"kubernetes.io/projected/d21770a8-375b-4c87-a7f5-847d940072d1-kube-api-access-fjz24\") pod \"volume-data-source-validator-5cf8c89d64-6lj9f\" (UID: \"d21770a8-375b-4c87-a7f5-847d940072d1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.178211 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vvvw\" (UniqueName: \"kubernetes.io/projected/af16bf09-0e98-4f24-9571-f94284be67ee-kube-api-access-9vvvw\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.178422 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-registry-certificates\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.178921 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/698fb556-3195-4931-807b-2159a1630cc2-ca-trust-extracted\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.179356 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-config\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.179356 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-trusted-ca\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.179827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.179629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-trusted-ca\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.180288 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.180272 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-serving-cert\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.180467 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.180445 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-installation-pull-secrets\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.180765 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.180750 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-image-registry-private-configuration\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.192192 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.192170 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-bound-sa-token\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.219358 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.219327 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjkpx\" (UniqueName: \"kubernetes.io/projected/bb32b748-2aa4-49af-aa2a-75f4bd4a20e2-kube-api-access-gjkpx\") pod \"console-operator-76dff48d59-4jwdp\" (UID: \"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2\") " pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.219811 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.219790 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6ss8\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-kube-api-access-x6ss8\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.220189 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.220171 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj5zx\" (UniqueName: \"kubernetes.io/projected/f591a2be-5f0d-4146-aa73-b9a58ef2a894-kube-api-access-mj5zx\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:28.220740 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.220723 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjz24\" (UniqueName: \"kubernetes.io/projected/d21770a8-375b-4c87-a7f5-847d940072d1-kube-api-access-fjz24\") pod \"volume-data-source-validator-5cf8c89d64-6lj9f\" (UID: \"d21770a8-375b-4c87-a7f5-847d940072d1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f" May 21 18:15:28.279027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.278938 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c35f900f-5f12-42bf-b03c-7648b91407e4-serving-cert\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.279027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.278974 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-tmp\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.279027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.278998 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vvvw\" (UniqueName: \"kubernetes.io/projected/af16bf09-0e98-4f24-9571-f94284be67ee-kube-api-access-9vvvw\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.279027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279027 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-service-ca-bundle\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279127 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-snapshots\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279176 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gj2g\" (UniqueName: \"kubernetes.io/projected/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-kube-api-access-9gj2g\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279269 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c35f900f-5f12-42bf-b03c-7648b91407e4-config\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.279364 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.279427 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls podName:af16bf09-0e98-4f24-9571-f94284be67ee nodeName:}" failed. No retries permitted until 2026-05-21 18:15:28.779409346 +0000 UTC m=+98.343500593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-7skkw" (UID: "af16bf09-0e98-4f24-9571-f94284be67ee") : secret "cluster-monitoring-operator-tls" not found May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279450 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af16bf09-0e98-4f24-9571-f94284be67ee-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279499 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279530 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-tmp\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279537 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-serving-cert\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279568 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwgf\" (UniqueName: \"kubernetes.io/projected/c35f900f-5f12-42bf-b03c-7648b91407e4-kube-api-access-7cwgf\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279785 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-snapshots\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279810 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-service-ca-bundle\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.279938 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c35f900f-5f12-42bf-b03c-7648b91407e4-config\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.280540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.280220 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.280540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.280262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af16bf09-0e98-4f24-9571-f94284be67ee-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.281790 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.281771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c35f900f-5f12-42bf-b03c-7648b91407e4-serving-cert\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.281959 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.281943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-serving-cert\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.296291 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.296263 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f797b8564-xnzdb"] May 21 18:15:28.298992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.298969 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.300615 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.300591 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cwgf\" (UniqueName: \"kubernetes.io/projected/c35f900f-5f12-42bf-b03c-7648b91407e4-kube-api-access-7cwgf\") pod \"service-ca-operator-57b5b68b8-2rrkp\" (UID: \"c35f900f-5f12-42bf-b03c-7648b91407e4\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.301477 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.301460 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:28.308024 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.308006 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 18:15:28.308024 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.308018 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bx87d\"" May 21 18:15:28.308667 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.308653 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 18:15:28.309600 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.309582 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 18:15:28.309600 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.309592 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 18:15:28.310066 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.310052 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 18:15:28.310952 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.310930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vvvw\" (UniqueName: \"kubernetes.io/projected/af16bf09-0e98-4f24-9571-f94284be67ee-kube-api-access-9vvvw\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.320521 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.320500 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 18:15:28.329407 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.329384 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f" May 21 18:15:28.335321 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.335292 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gj2g\" (UniqueName: \"kubernetes.io/projected/d55c7689-dc4f-42f9-a8db-dc3270bb60e8-kube-api-access-9gj2g\") pod \"insights-operator-78bdfb888c-spwhr\" (UID: \"d55c7689-dc4f-42f9-a8db-dc3270bb60e8\") " pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.350491 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.350425 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f797b8564-xnzdb"] May 21 18:15:28.380678 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.380522 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8xnb\" (UniqueName: \"kubernetes.io/projected/cd0bb322-8104-4cdf-b79f-1a5eed62f559-kube-api-access-v8xnb\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.380678 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.380604 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.380817 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.380687 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-default-certificate\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.380877 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.380841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-stats-auth\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.381519 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.380972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.433893 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.433855 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" May 21 18:15:28.441477 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.441451 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-4jwdp"] May 21 18:15:28.443708 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:15:28.443681 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb32b748_2aa4_49af_aa2a_75f4bd4a20e2.slice/crio-dfbc56d1b2f8f7ed93f193c49d5cb16ccf8d48d4ee98f83f399a39fb97157a65 WatchSource:0}: Error finding container dfbc56d1b2f8f7ed93f193c49d5cb16ccf8d48d4ee98f83f399a39fb97157a65: Status 404 returned error can't find the container with id dfbc56d1b2f8f7ed93f193c49d5cb16ccf8d48d4ee98f83f399a39fb97157a65 May 21 18:15:28.454070 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.454032 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-spwhr" May 21 18:15:28.456347 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.456317 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f"] May 21 18:15:28.459975 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:15:28.459946 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21770a8_375b_4c87_a7f5_847d940072d1.slice/crio-932d1f8da104649741a9dad20d7b36b70eba0e884e17815b11da79d3627b2f48 WatchSource:0}: Error finding container 932d1f8da104649741a9dad20d7b36b70eba0e884e17815b11da79d3627b2f48: Status 404 returned error can't find the container with id 932d1f8da104649741a9dad20d7b36b70eba0e884e17815b11da79d3627b2f48 May 21 18:15:28.481698 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.481648 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8xnb\" (UniqueName: \"kubernetes.io/projected/cd0bb322-8104-4cdf-b79f-1a5eed62f559-kube-api-access-v8xnb\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.481816 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.481724 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.481816 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.481785 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-default-certificate\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.482027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.481888 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-stats-auth\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.482027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.481958 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.482367 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.482297 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:28.98227406 +0000 UTC m=+98.546365319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : configmap references non-existent config key: service-ca.crt May 21 18:15:28.482934 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.482829 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 18:15:28.482934 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.482898 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:28.982881948 +0000 UTC m=+98.546973190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : secret "router-metrics-certs-default" not found May 21 18:15:28.485533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.485511 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-default-certificate\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.485729 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.485674 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-stats-auth\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.490003 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.489978 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8xnb\" (UniqueName: \"kubernetes.io/projected/cd0bb322-8104-4cdf-b79f-1a5eed62f559-kube-api-access-v8xnb\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.562441 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.562417 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp"] May 21 18:15:28.564807 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:15:28.564780 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35f900f_5f12_42bf_b03c_7648b91407e4.slice/crio-18db6bc102c308ac3f25df844d5aacefedc0c47b0edf5e849a14af07c1d1bf98 WatchSource:0}: Error finding container 18db6bc102c308ac3f25df844d5aacefedc0c47b0edf5e849a14af07c1d1bf98: Status 404 returned error can't find the container with id 18db6bc102c308ac3f25df844d5aacefedc0c47b0edf5e849a14af07c1d1bf98 May 21 18:15:28.583328 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.583306 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-spwhr"] May 21 18:15:28.585792 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:15:28.585772 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55c7689_dc4f_42f9_a8db_dc3270bb60e8.slice/crio-977b46108aa217c7f38dc452afce4f59996cc273914be5c647563bad305561ab WatchSource:0}: Error finding container 977b46108aa217c7f38dc452afce4f59996cc273914be5c647563bad305561ab: Status 404 returned error can't find the container with id 977b46108aa217c7f38dc452afce4f59996cc273914be5c647563bad305561ab May 21 18:15:28.683956 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.683919 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:28.683956 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.683958 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:28.684177 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.684062 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 18:15:28.684177 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.684130 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls podName:f591a2be-5f0d-4146-aa73-b9a58ef2a894 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:29.684093885 +0000 UTC m=+99.248185124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls") pod "cluster-samples-operator-697587599-z4m9j" (UID: "f591a2be-5f0d-4146-aa73-b9a58ef2a894") : secret "samples-operator-tls" not found May 21 18:15:28.684258 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.684169 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:15:28.684258 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.684198 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f4555f475-tqm5j: secret "image-registry-tls" not found May 21 18:15:28.684258 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.684240 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls podName:698fb556-3195-4931-807b-2159a1630cc2 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:29.684229343 +0000 UTC m=+99.248320581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls") pod "image-registry-6f4555f475-tqm5j" (UID: "698fb556-3195-4931-807b-2159a1630cc2") : secret "image-registry-tls" not found May 21 18:15:28.785489 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.785398 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:28.785640 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.785521 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 18:15:28.785640 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.785574 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls podName:af16bf09-0e98-4f24-9571-f94284be67ee nodeName:}" failed. No retries permitted until 2026-05-21 18:15:29.785560154 +0000 UTC m=+99.349651397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-7skkw" (UID: "af16bf09-0e98-4f24-9571-f94284be67ee") : secret "cluster-monitoring-operator-tls" not found May 21 18:15:28.987305 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.987270 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.987469 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:28.987318 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:28.987469 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.987433 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 18:15:28.987469 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.987439 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:29.987422392 +0000 UTC m=+99.551513630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : configmap references non-existent config key: service-ca.crt May 21 18:15:28.987469 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:28.987470 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:29.987460041 +0000 UTC m=+99.551551280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : secret "router-metrics-certs-default" not found May 21 18:15:29.295995 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.295948 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f" event={"ID":"d21770a8-375b-4c87-a7f5-847d940072d1","Type":"ContainerStarted","Data":"932d1f8da104649741a9dad20d7b36b70eba0e884e17815b11da79d3627b2f48"} May 21 18:15:29.297628 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.297601 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" event={"ID":"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2","Type":"ContainerStarted","Data":"dfbc56d1b2f8f7ed93f193c49d5cb16ccf8d48d4ee98f83f399a39fb97157a65"} May 21 18:15:29.301696 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.301647 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" event={"ID":"c35f900f-5f12-42bf-b03c-7648b91407e4","Type":"ContainerStarted","Data":"18db6bc102c308ac3f25df844d5aacefedc0c47b0edf5e849a14af07c1d1bf98"} May 21 18:15:29.303284 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.303260 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-spwhr" event={"ID":"d55c7689-dc4f-42f9-a8db-dc3270bb60e8","Type":"ContainerStarted","Data":"977b46108aa217c7f38dc452afce4f59996cc273914be5c647563bad305561ab"} May 21 18:15:29.693867 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.693643 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:29.693867 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.693695 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:29.693867 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.693841 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:15:29.693867 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.693861 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f4555f475-tqm5j: secret "image-registry-tls" not found May 21 18:15:29.694179 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.693931 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls podName:698fb556-3195-4931-807b-2159a1630cc2 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:31.693911883 +0000 UTC m=+101.258003127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls") pod "image-registry-6f4555f475-tqm5j" (UID: "698fb556-3195-4931-807b-2159a1630cc2") : secret "image-registry-tls" not found May 21 18:15:29.694179 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.693970 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 18:15:29.694179 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.694051 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls podName:f591a2be-5f0d-4146-aa73-b9a58ef2a894 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:31.694033374 +0000 UTC m=+101.258124618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls") pod "cluster-samples-operator-697587599-z4m9j" (UID: "f591a2be-5f0d-4146-aa73-b9a58ef2a894") : secret "samples-operator-tls" not found May 21 18:15:29.795210 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.795170 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:29.795399 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.795311 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 18:15:29.795399 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.795384 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls podName:af16bf09-0e98-4f24-9571-f94284be67ee nodeName:}" failed. No retries permitted until 2026-05-21 18:15:31.795364492 +0000 UTC m=+101.359455745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-7skkw" (UID: "af16bf09-0e98-4f24-9571-f94284be67ee") : secret "cluster-monitoring-operator-tls" not found May 21 18:15:29.997089 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.997048 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:29.997359 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:29.997120 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:29.997425 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.997364 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 18:15:29.997425 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.997377 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:31.997352305 +0000 UTC m=+101.561443545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : configmap references non-existent config key: service-ca.crt May 21 18:15:29.997425 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:29.997409 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:31.997398162 +0000 UTC m=+101.561489406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : secret "router-metrics-certs-default" not found May 21 18:15:30.307436 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:30.307344 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f" event={"ID":"d21770a8-375b-4c87-a7f5-847d940072d1","Type":"ContainerStarted","Data":"f55e9a7d600b0086dae95ab317c63dc2575452797598310b5287a538fa9ee1fd"} May 21 18:15:30.322685 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:30.322629 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-6lj9f" podStartSLOduration=1.654219369 podStartE2EDuration="3.32261086s" podCreationTimestamp="2026-05-21 18:15:27 +0000 UTC" firstStartedPulling="2026-05-21 18:15:28.461974427 +0000 UTC m=+98.026065680" lastFinishedPulling="2026-05-21 18:15:30.13036592 +0000 UTC m=+99.694457171" observedRunningTime="2026-05-21 18:15:30.321429339 +0000 UTC m=+99.885520601" watchObservedRunningTime="2026-05-21 18:15:30.32261086 +0000 UTC m=+99.886702122" May 21 18:15:31.311482 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:31.311439 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-spwhr" event={"ID":"d55c7689-dc4f-42f9-a8db-dc3270bb60e8","Type":"ContainerStarted","Data":"69d10389381b44bc3968bdf9c209e486c7d9bd74f886cb609a7b72dd76c8fac1"} May 21 18:15:31.327788 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:31.327494 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-spwhr" podStartSLOduration=1.231874122 podStartE2EDuration="3.327476867s" podCreationTimestamp="2026-05-21 18:15:28 +0000 UTC" firstStartedPulling="2026-05-21 18:15:28.589132604 +0000 UTC m=+98.153223846" lastFinishedPulling="2026-05-21 18:15:30.684735349 +0000 UTC m=+100.248826591" observedRunningTime="2026-05-21 18:15:31.32715813 +0000 UTC m=+100.891249391" watchObservedRunningTime="2026-05-21 18:15:31.327476867 +0000 UTC m=+100.891568128" May 21 18:15:31.712572 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:31.712477 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:15:31.712748 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:31.712606 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:15:31.712748 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:31.712630 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:31.712748 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712645 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:15:31.712748 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712732 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls podName:c054bab1-a1e6-4166-afe9-c02f7cf4a0bd nodeName:}" failed. No retries permitted until 2026-05-21 18:16:35.712705998 +0000 UTC m=+165.276797262 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls") pod "dns-default-ml5nd" (UID: "c054bab1-a1e6-4166-afe9-c02f7cf4a0bd") : secret "dns-default-metrics-tls" not found May 21 18:15:31.712748 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712738 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 18:15:31.713004 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712757 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:15:31.713004 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712788 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls podName:f591a2be-5f0d-4146-aa73-b9a58ef2a894 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:35.712772731 +0000 UTC m=+105.276863977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls") pod "cluster-samples-operator-697587599-z4m9j" (UID: "f591a2be-5f0d-4146-aa73-b9a58ef2a894") : secret "samples-operator-tls" not found May 21 18:15:31.713004 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712789 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:15:31.713004 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712807 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f4555f475-tqm5j: secret "image-registry-tls" not found May 21 18:15:31.713004 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712824 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert podName:0e84d92d-02a2-436b-a0dd-92d3d7891a7b nodeName:}" failed. No retries permitted until 2026-05-21 18:16:35.712807941 +0000 UTC m=+165.276899192 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert") pod "ingress-canary-rqs4r" (UID: "0e84d92d-02a2-436b-a0dd-92d3d7891a7b") : secret "canary-serving-cert" not found May 21 18:15:31.713004 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.712861 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls podName:698fb556-3195-4931-807b-2159a1630cc2 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:35.712846795 +0000 UTC m=+105.276938048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls") pod "image-registry-6f4555f475-tqm5j" (UID: "698fb556-3195-4931-807b-2159a1630cc2") : secret "image-registry-tls" not found May 21 18:15:31.713004 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:31.712655 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:31.813684 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:31.813632 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:31.813865 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.813787 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 18:15:31.813923 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:31.813869 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls podName:af16bf09-0e98-4f24-9571-f94284be67ee nodeName:}" failed. No retries permitted until 2026-05-21 18:15:35.813848827 +0000 UTC m=+105.377940068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-7skkw" (UID: "af16bf09-0e98-4f24-9571-f94284be67ee") : secret "cluster-monitoring-operator-tls" not found May 21 18:15:32.016151 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.016089 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:32.016340 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.016192 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:32.016401 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:32.016346 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:36.016328957 +0000 UTC m=+105.580420203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : configmap references non-existent config key: service-ca.crt May 21 18:15:32.016472 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:32.016428 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 18:15:32.016472 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:32.016468 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:36.016457667 +0000 UTC m=+105.580548910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : secret "router-metrics-certs-default" not found May 21 18:15:32.247854 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.247822 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xj4l2" May 21 18:15:32.315256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.315183 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/0.log" May 21 18:15:32.315256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.315227 2555 generic.go:358] "Generic (PLEG): container finished" podID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" containerID="f2cd1b643fe9411c74a1eaa313b0a407bcec1e3359d947f265a8524522974293" exitCode=255 May 21 18:15:32.315729 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.315307 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" event={"ID":"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2","Type":"ContainerDied","Data":"f2cd1b643fe9411c74a1eaa313b0a407bcec1e3359d947f265a8524522974293"} May 21 18:15:32.315729 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.315590 2555 scope.go:117] "RemoveContainer" containerID="f2cd1b643fe9411c74a1eaa313b0a407bcec1e3359d947f265a8524522974293" May 21 18:15:32.317680 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.317348 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" event={"ID":"c35f900f-5f12-42bf-b03c-7648b91407e4","Type":"ContainerStarted","Data":"cc4c15a63bcb4d49a3d9943f1d2c6c4e34a57b2cd37970c08ff8c9388091af08"} May 21 18:15:32.345532 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:32.345488 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" podStartSLOduration=0.841851618 podStartE2EDuration="4.345474707s" podCreationTimestamp="2026-05-21 18:15:28 +0000 UTC" firstStartedPulling="2026-05-21 18:15:28.566617306 +0000 UTC m=+98.130708549" lastFinishedPulling="2026-05-21 18:15:32.070240396 +0000 UTC m=+101.634331638" observedRunningTime="2026-05-21 18:15:32.344383692 +0000 UTC m=+101.908474955" watchObservedRunningTime="2026-05-21 18:15:32.345474707 +0000 UTC m=+101.909565969" May 21 18:15:33.320732 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:33.320700 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/1.log" May 21 18:15:33.321152 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:33.321142 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/0.log" May 21 18:15:33.321201 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:33.321175 2555 generic.go:358] "Generic (PLEG): container finished" podID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" containerID="e79ee876bcf35884bd63df12beff03f2e3e60ab0c76aebb3836c465b31ee2adc" exitCode=255 May 21 18:15:33.321296 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:33.321268 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" event={"ID":"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2","Type":"ContainerDied","Data":"e79ee876bcf35884bd63df12beff03f2e3e60ab0c76aebb3836c465b31ee2adc"} May 21 18:15:33.321348 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:33.321335 2555 scope.go:117] "RemoveContainer" containerID="f2cd1b643fe9411c74a1eaa313b0a407bcec1e3359d947f265a8524522974293" May 21 18:15:33.321580 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:33.321548 2555 scope.go:117] "RemoveContainer" containerID="e79ee876bcf35884bd63df12beff03f2e3e60ab0c76aebb3836c465b31ee2adc" May 21 18:15:33.321805 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:33.321786 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-4jwdp_openshift-console-operator(bb32b748-2aa4-49af-aa2a-75f4bd4a20e2)\"" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" podUID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" May 21 18:15:34.015803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.015767 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf"] May 21 18:15:34.018443 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.018426 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:34.020758 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.020734 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 18:15:34.020875 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.020735 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 18:15:34.020875 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.020810 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ttdzf\"" May 21 18:15:34.026205 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.026185 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf"] May 21 18:15:34.131616 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.131570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:34.131803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.131698 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2acffa6e-505b-4ad8-9148-e3902dd73951-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:34.233092 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.233044 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:34.233289 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.233173 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2acffa6e-505b-4ad8-9148-e3902dd73951-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:34.233289 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:34.233213 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:15:34.233289 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:34.233285 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert podName:2acffa6e-505b-4ad8-9148-e3902dd73951 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:34.733265131 +0000 UTC m=+104.297356383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-khmbf" (UID: "2acffa6e-505b-4ad8-9148-e3902dd73951") : secret "networking-console-plugin-cert" not found May 21 18:15:34.233763 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.233744 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2acffa6e-505b-4ad8-9148-e3902dd73951-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:34.324389 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.324306 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/1.log" May 21 18:15:34.324824 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.324732 2555 scope.go:117] "RemoveContainer" containerID="e79ee876bcf35884bd63df12beff03f2e3e60ab0c76aebb3836c465b31ee2adc" May 21 18:15:34.324963 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:34.324941 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-4jwdp_openshift-console-operator(bb32b748-2aa4-49af-aa2a-75f4bd4a20e2)\"" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" podUID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" May 21 18:15:34.738448 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:34.738405 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:34.738627 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:34.738525 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:15:34.738627 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:34.738591 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert podName:2acffa6e-505b-4ad8-9148-e3902dd73951 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:35.738575927 +0000 UTC m=+105.302667167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-khmbf" (UID: "2acffa6e-505b-4ad8-9148-e3902dd73951") : secret "networking-console-plugin-cert" not found May 21 18:15:35.382946 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:35.382920 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jl9vw_a8bfa48b-d2e0-4202-a074-f0dfff223c4a/dns-node-resolver/0.log" May 21 18:15:35.745498 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:35.745465 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:35.745657 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:35.745513 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:35.745657 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:35.745559 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:35.745657 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.745621 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:15:35.745657 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.745640 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f4555f475-tqm5j: secret "image-registry-tls" not found May 21 18:15:35.745787 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.745667 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:15:35.745787 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.745670 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 18:15:35.745787 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.745696 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls podName:698fb556-3195-4931-807b-2159a1630cc2 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:43.745680379 +0000 UTC m=+113.309771618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls") pod "image-registry-6f4555f475-tqm5j" (UID: "698fb556-3195-4931-807b-2159a1630cc2") : secret "image-registry-tls" not found May 21 18:15:35.745787 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.745711 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert podName:2acffa6e-505b-4ad8-9148-e3902dd73951 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:37.745704662 +0000 UTC m=+107.309795901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-khmbf" (UID: "2acffa6e-505b-4ad8-9148-e3902dd73951") : secret "networking-console-plugin-cert" not found May 21 18:15:35.745787 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.745722 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls podName:f591a2be-5f0d-4146-aa73-b9a58ef2a894 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:43.745716171 +0000 UTC m=+113.309807410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls") pod "cluster-samples-operator-697587599-z4m9j" (UID: "f591a2be-5f0d-4146-aa73-b9a58ef2a894") : secret "samples-operator-tls" not found May 21 18:15:35.846835 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:35.846799 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:35.847003 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.846931 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 18:15:35.847003 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:35.846996 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls podName:af16bf09-0e98-4f24-9571-f94284be67ee nodeName:}" failed. No retries permitted until 2026-05-21 18:15:43.846984806 +0000 UTC m=+113.411076045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-7skkw" (UID: "af16bf09-0e98-4f24-9571-f94284be67ee") : secret "cluster-monitoring-operator-tls" not found May 21 18:15:36.049326 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:36.049236 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:36.049326 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:36.049300 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:36.049509 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:36.049411 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 18:15:36.049509 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:36.049486 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:44.049470635 +0000 UTC m=+113.613561877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : configmap references non-existent config key: service-ca.crt May 21 18:15:36.049509 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:36.049507 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:44.049499119 +0000 UTC m=+113.613590357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : secret "router-metrics-certs-default" not found May 21 18:15:36.382721 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:36.382648 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hrv95_5493a7d9-c08d-4fdb-9917-ee56c14088ce/node-ca/0.log" May 21 18:15:37.762424 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:37.762383 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:37.762836 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:37.762514 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:15:37.762836 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:37.762584 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert podName:2acffa6e-505b-4ad8-9148-e3902dd73951 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:41.76256836 +0000 UTC m=+111.326659599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-khmbf" (UID: "2acffa6e-505b-4ad8-9148-e3902dd73951") : secret "networking-console-plugin-cert" not found May 21 18:15:38.302206 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:38.302177 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:38.302371 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:38.302216 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:38.302592 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:38.302578 2555 scope.go:117] "RemoveContainer" containerID="e79ee876bcf35884bd63df12beff03f2e3e60ab0c76aebb3836c465b31ee2adc" May 21 18:15:38.302751 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:38.302735 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-4jwdp_openshift-console-operator(bb32b748-2aa4-49af-aa2a-75f4bd4a20e2)\"" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" podUID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" May 21 18:15:41.797401 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:41.797341 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:41.797802 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:41.797491 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:15:41.797802 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:41.797563 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert podName:2acffa6e-505b-4ad8-9148-e3902dd73951 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:49.79754685 +0000 UTC m=+119.361638088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-khmbf" (UID: "2acffa6e-505b-4ad8-9148-e3902dd73951") : secret "networking-console-plugin-cert" not found May 21 18:15:43.813622 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:43.813586 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:43.813622 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:43.813628 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:43.816010 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:43.815988 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"image-registry-6f4555f475-tqm5j\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:43.816082 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:43.816063 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f591a2be-5f0d-4146-aa73-b9a58ef2a894-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z4m9j\" (UID: \"f591a2be-5f0d-4146-aa73-b9a58ef2a894\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:43.914092 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:43.914057 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:43.914292 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:43.914232 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 18:15:43.914356 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:43.914315 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls podName:af16bf09-0e98-4f24-9571-f94284be67ee nodeName:}" failed. No retries permitted until 2026-05-21 18:15:59.914293824 +0000 UTC m=+129.478385065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-7skkw" (UID: "af16bf09-0e98-4f24-9571-f94284be67ee") : secret "cluster-monitoring-operator-tls" not found May 21 18:15:43.921019 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:43.920995 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" May 21 18:15:43.934585 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:43.934549 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:44.054372 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.054344 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j"] May 21 18:15:44.067791 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.067729 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f4555f475-tqm5j"] May 21 18:15:44.076076 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:15:44.076052 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698fb556_3195_4931_807b_2159a1630cc2.slice/crio-5bcf99f1d4a4741ffb9a4e3f1b80a55917d9575cc8749574b73a7fb1c73715ab WatchSource:0}: Error finding container 5bcf99f1d4a4741ffb9a4e3f1b80a55917d9575cc8749574b73a7fb1c73715ab: Status 404 returned error can't find the container with id 5bcf99f1d4a4741ffb9a4e3f1b80a55917d9575cc8749574b73a7fb1c73715ab May 21 18:15:44.115058 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.115030 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:44.115200 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.115074 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:15:44.115273 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:44.115230 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:16:00.115208581 +0000 UTC m=+129.679299821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : configmap references non-existent config key: service-ca.crt May 21 18:15:44.115399 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:44.115271 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 18:15:44.115399 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:44.115336 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs podName:cd0bb322-8104-4cdf-b79f-1a5eed62f559 nodeName:}" failed. No retries permitted until 2026-05-21 18:16:00.11532021 +0000 UTC m=+129.679411467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs") pod "router-default-7f797b8564-xnzdb" (UID: "cd0bb322-8104-4cdf-b79f-1a5eed62f559") : secret "router-metrics-certs-default" not found May 21 18:15:44.346347 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.346260 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" event={"ID":"f591a2be-5f0d-4146-aa73-b9a58ef2a894","Type":"ContainerStarted","Data":"83d37df64c90f35d1bf4a39d93e35174068f09f6d5da9a0a0396a5713ccb669a"} May 21 18:15:44.347540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.347514 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" event={"ID":"698fb556-3195-4931-807b-2159a1630cc2","Type":"ContainerStarted","Data":"97006c15df9e81d7ee2529fde87a242ae547ceae13378d7d1ddb8eebee8d6b50"} May 21 18:15:44.347648 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.347550 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" event={"ID":"698fb556-3195-4931-807b-2159a1630cc2","Type":"ContainerStarted","Data":"5bcf99f1d4a4741ffb9a4e3f1b80a55917d9575cc8749574b73a7fb1c73715ab"} May 21 18:15:44.347648 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.347636 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:15:44.364406 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:44.364362 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" podStartSLOduration=17.36434797 podStartE2EDuration="17.36434797s" podCreationTimestamp="2026-05-21 18:15:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:15:44.363683513 +0000 UTC m=+113.927774777" watchObservedRunningTime="2026-05-21 18:15:44.36434797 +0000 UTC m=+113.928439231" May 21 18:15:46.354775 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:46.354745 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" event={"ID":"f591a2be-5f0d-4146-aa73-b9a58ef2a894","Type":"ContainerStarted","Data":"9be50638ba79b0a829811167dea736ce7d0bee2af1a91d6b1fc98e95c67cdad6"} May 21 18:15:47.358824 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:47.358786 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" event={"ID":"f591a2be-5f0d-4146-aa73-b9a58ef2a894","Type":"ContainerStarted","Data":"cc9e7455074f0983e0487ac773d3c60998d33bb40c421dee451eed0dcc99b1b5"} May 21 18:15:47.375939 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:47.375891 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z4m9j" podStartSLOduration=18.248954126 podStartE2EDuration="20.375878014s" podCreationTimestamp="2026-05-21 18:15:27 +0000 UTC" firstStartedPulling="2026-05-21 18:15:44.097204388 +0000 UTC m=+113.661295627" lastFinishedPulling="2026-05-21 18:15:46.224128265 +0000 UTC m=+115.788219515" observedRunningTime="2026-05-21 18:15:47.374162141 +0000 UTC m=+116.938253402" watchObservedRunningTime="2026-05-21 18:15:47.375878014 +0000 UTC m=+116.939969275" May 21 18:15:49.867367 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:49.867322 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:49.869683 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:49.869660 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2acffa6e-505b-4ad8-9148-e3902dd73951-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-khmbf\" (UID: \"2acffa6e-505b-4ad8-9148-e3902dd73951\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:49.927870 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:49.927818 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" May 21 18:15:50.017258 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.017233 2555 scope.go:117] "RemoveContainer" containerID="e79ee876bcf35884bd63df12beff03f2e3e60ab0c76aebb3836c465b31ee2adc" May 21 18:15:50.062606 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.062581 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf"] May 21 18:15:50.065670 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:15:50.065642 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acffa6e_505b_4ad8_9148_e3902dd73951.slice/crio-90e56612a7bd2c26e4d42e09075cfa023c7b3d88f82cf18ddfb285c9c6c4923e WatchSource:0}: Error finding container 90e56612a7bd2c26e4d42e09075cfa023c7b3d88f82cf18ddfb285c9c6c4923e: Status 404 returned error can't find the container with id 90e56612a7bd2c26e4d42e09075cfa023c7b3d88f82cf18ddfb285c9c6c4923e May 21 18:15:50.367260 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.367222 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" event={"ID":"2acffa6e-505b-4ad8-9148-e3902dd73951","Type":"ContainerStarted","Data":"90e56612a7bd2c26e4d42e09075cfa023c7b3d88f82cf18ddfb285c9c6c4923e"} May 21 18:15:50.368469 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.368448 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:15:50.368781 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.368765 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/1.log" May 21 18:15:50.368855 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.368802 2555 generic.go:358] "Generic (PLEG): container finished" podID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" containerID="8720266f7bb2ae64628a99941486fc98ce32f403ce99eea38b0e835365f73956" exitCode=255 May 21 18:15:50.368855 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.368838 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" event={"ID":"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2","Type":"ContainerDied","Data":"8720266f7bb2ae64628a99941486fc98ce32f403ce99eea38b0e835365f73956"} May 21 18:15:50.368961 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.368871 2555 scope.go:117] "RemoveContainer" containerID="e79ee876bcf35884bd63df12beff03f2e3e60ab0c76aebb3836c465b31ee2adc" May 21 18:15:50.369202 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:50.369181 2555 scope.go:117] "RemoveContainer" containerID="8720266f7bb2ae64628a99941486fc98ce32f403ce99eea38b0e835365f73956" May 21 18:15:50.369422 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:50.369399 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-4jwdp_openshift-console-operator(bb32b748-2aa4-49af-aa2a-75f4bd4a20e2)\"" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" podUID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" May 21 18:15:51.374381 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:51.374346 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" event={"ID":"2acffa6e-505b-4ad8-9148-e3902dd73951","Type":"ContainerStarted","Data":"54305ec9023b1681d4d313494a7f5a73cbfe0d57a5165dd1be7f00de0a2d9017"} May 21 18:15:51.375694 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:51.375676 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:15:51.388440 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:51.388400 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-khmbf" podStartSLOduration=17.270234129 podStartE2EDuration="18.388387824s" podCreationTimestamp="2026-05-21 18:15:33 +0000 UTC" firstStartedPulling="2026-05-21 18:15:50.067814066 +0000 UTC m=+119.631905308" lastFinishedPulling="2026-05-21 18:15:51.185967759 +0000 UTC m=+120.750059003" observedRunningTime="2026-05-21 18:15:51.387206488 +0000 UTC m=+120.951297748" watchObservedRunningTime="2026-05-21 18:15:51.388387824 +0000 UTC m=+120.952479085" May 21 18:15:55.342235 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.342204 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8gk69"] May 21 18:15:55.344636 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.344604 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.346904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.346882 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 18:15:55.347597 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.347580 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 18:15:55.347688 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.347595 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mhnx6\"" May 21 18:15:55.353942 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.353913 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8gk69"] May 21 18:15:55.361446 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.361421 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f4555f475-tqm5j"] May 21 18:15:55.513450 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.513414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/afd0da26-ca98-4791-bbab-b288a7010fdf-crio-socket\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.513642 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.513491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/afd0da26-ca98-4791-bbab-b288a7010fdf-data-volume\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.513642 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.513530 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/afd0da26-ca98-4791-bbab-b288a7010fdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.513642 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.513599 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/afd0da26-ca98-4791-bbab-b288a7010fdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.513823 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.513671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r772r\" (UniqueName: \"kubernetes.io/projected/afd0da26-ca98-4791-bbab-b288a7010fdf-kube-api-access-r772r\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.614306 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.614211 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/afd0da26-ca98-4791-bbab-b288a7010fdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.614306 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.614273 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r772r\" (UniqueName: \"kubernetes.io/projected/afd0da26-ca98-4791-bbab-b288a7010fdf-kube-api-access-r772r\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.614533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.614309 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/afd0da26-ca98-4791-bbab-b288a7010fdf-crio-socket\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.614533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.614400 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/afd0da26-ca98-4791-bbab-b288a7010fdf-data-volume\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.614533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.614446 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/afd0da26-ca98-4791-bbab-b288a7010fdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.614689 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.614535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/afd0da26-ca98-4791-bbab-b288a7010fdf-crio-socket\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.614730 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.614718 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/afd0da26-ca98-4791-bbab-b288a7010fdf-data-volume\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.614898 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.614881 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/afd0da26-ca98-4791-bbab-b288a7010fdf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.616667 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.616643 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/afd0da26-ca98-4791-bbab-b288a7010fdf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.623696 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.623672 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r772r\" (UniqueName: \"kubernetes.io/projected/afd0da26-ca98-4791-bbab-b288a7010fdf-kube-api-access-r772r\") pod \"insights-runtime-extractor-8gk69\" (UID: \"afd0da26-ca98-4791-bbab-b288a7010fdf\") " pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.653696 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.653665 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8gk69" May 21 18:15:55.784541 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:55.784509 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8gk69"] May 21 18:15:55.787775 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:15:55.787750 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd0da26_ca98_4791_bbab_b288a7010fdf.slice/crio-0d69a294b21acb81d539eba35d2d21ad716573efa5b5b140a50fb17b4a0ea0fb WatchSource:0}: Error finding container 0d69a294b21acb81d539eba35d2d21ad716573efa5b5b140a50fb17b4a0ea0fb: Status 404 returned error can't find the container with id 0d69a294b21acb81d539eba35d2d21ad716573efa5b5b140a50fb17b4a0ea0fb May 21 18:15:56.389471 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:56.389438 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gk69" event={"ID":"afd0da26-ca98-4791-bbab-b288a7010fdf","Type":"ContainerStarted","Data":"6517df6181ea8081be8e0b35673f35b61f409b942723c9948cae0c57f0007b18"} May 21 18:15:56.389471 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:56.389474 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gk69" event={"ID":"afd0da26-ca98-4791-bbab-b288a7010fdf","Type":"ContainerStarted","Data":"0d69a294b21acb81d539eba35d2d21ad716573efa5b5b140a50fb17b4a0ea0fb"} May 21 18:15:57.398074 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:57.398034 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gk69" event={"ID":"afd0da26-ca98-4791-bbab-b288a7010fdf","Type":"ContainerStarted","Data":"c31623823f0d7dd99dfe366dbb5a2e2fc1af8b38e612135e5b4a507fae675d61"} May 21 18:15:58.301629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:58.301594 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:58.301740 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:58.301654 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:15:58.302064 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:58.302050 2555 scope.go:117] "RemoveContainer" containerID="8720266f7bb2ae64628a99941486fc98ce32f403ce99eea38b0e835365f73956" May 21 18:15:58.302337 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:15:58.302315 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-4jwdp_openshift-console-operator(bb32b748-2aa4-49af-aa2a-75f4bd4a20e2)\"" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" podUID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" May 21 18:15:58.402480 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:58.402435 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gk69" event={"ID":"afd0da26-ca98-4791-bbab-b288a7010fdf","Type":"ContainerStarted","Data":"5d2a22bfd4e5cbbc4a50d0467f5f5e3fca056590e56542436389a5e96905f911"} May 21 18:15:58.418390 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:58.418346 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8gk69" podStartSLOduration=1.039794398 podStartE2EDuration="3.418331545s" podCreationTimestamp="2026-05-21 18:15:55 +0000 UTC" firstStartedPulling="2026-05-21 18:15:55.833798741 +0000 UTC m=+125.397889981" lastFinishedPulling="2026-05-21 18:15:58.212335885 +0000 UTC m=+127.776427128" observedRunningTime="2026-05-21 18:15:58.417179954 +0000 UTC m=+127.981271216" watchObservedRunningTime="2026-05-21 18:15:58.418331545 +0000 UTC m=+127.982422864" May 21 18:15:59.951527 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:59.951486 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:15:59.953968 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:15:59.953942 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af16bf09-0e98-4f24-9571-f94284be67ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-7skkw\" (UID: \"af16bf09-0e98-4f24-9571-f94284be67ee\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:16:00.152591 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.152534 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:00.152591 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.152604 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:00.153203 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.153183 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0bb322-8104-4cdf-b79f-1a5eed62f559-service-ca-bundle\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:00.154902 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.154879 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0bb322-8104-4cdf-b79f-1a5eed62f559-metrics-certs\") pod \"router-default-7f797b8564-xnzdb\" (UID: \"cd0bb322-8104-4cdf-b79f-1a5eed62f559\") " pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:00.249434 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.249400 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fjkpq\"" May 21 18:16:00.257481 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.257457 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" May 21 18:16:00.375706 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.375675 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw"] May 21 18:16:00.378785 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:00.378759 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf16bf09_0e98_4f24_9571_f94284be67ee.slice/crio-d7dd50c0265fe4c61769e44323ab803a8ee6a5c4b3d53036865f095307d65270 WatchSource:0}: Error finding container d7dd50c0265fe4c61769e44323ab803a8ee6a5c4b3d53036865f095307d65270: Status 404 returned error can't find the container with id d7dd50c0265fe4c61769e44323ab803a8ee6a5c4b3d53036865f095307d65270 May 21 18:16:00.408362 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.408328 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" event={"ID":"af16bf09-0e98-4f24-9571-f94284be67ee","Type":"ContainerStarted","Data":"d7dd50c0265fe4c61769e44323ab803a8ee6a5c4b3d53036865f095307d65270"} May 21 18:16:00.409422 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.409406 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bx87d\"" May 21 18:16:00.418182 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.418162 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:00.553482 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.553421 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f797b8564-xnzdb"] May 21 18:16:00.555796 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:00.555766 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0bb322_8104_4cdf_b79f_1a5eed62f559.slice/crio-19d4de7bd8c9fe028eb9ddf4bb85c4619e73b925161a29f8b11c45d35e16d455 WatchSource:0}: Error finding container 19d4de7bd8c9fe028eb9ddf4bb85c4619e73b925161a29f8b11c45d35e16d455: Status 404 returned error can't find the container with id 19d4de7bd8c9fe028eb9ddf4bb85c4619e73b925161a29f8b11c45d35e16d455 May 21 18:16:00.756874 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.756838 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:16:00.759064 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.759002 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e102289-f8a8-475e-8f4e-422e0a01eed3-metrics-certs\") pod \"network-metrics-daemon-b8mgd\" (UID: \"4e102289-f8a8-475e-8f4e-422e0a01eed3\") " pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:16:00.830864 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.830829 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tccs\"" May 21 18:16:00.839170 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.839150 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8mgd" May 21 18:16:00.957594 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:00.957565 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b8mgd"] May 21 18:16:00.961167 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:00.961137 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e102289_f8a8_475e_8f4e_422e0a01eed3.slice/crio-34140defbb78d675d71b68867b43c4159fb2eff8d1f08fe0646a007f047fcbde WatchSource:0}: Error finding container 34140defbb78d675d71b68867b43c4159fb2eff8d1f08fe0646a007f047fcbde: Status 404 returned error can't find the container with id 34140defbb78d675d71b68867b43c4159fb2eff8d1f08fe0646a007f047fcbde May 21 18:16:01.412969 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:01.412923 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b8mgd" event={"ID":"4e102289-f8a8-475e-8f4e-422e0a01eed3","Type":"ContainerStarted","Data":"34140defbb78d675d71b68867b43c4159fb2eff8d1f08fe0646a007f047fcbde"} May 21 18:16:01.414542 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:01.414504 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f797b8564-xnzdb" event={"ID":"cd0bb322-8104-4cdf-b79f-1a5eed62f559","Type":"ContainerStarted","Data":"64fa04ae026b5e0c064330a9a020a1e5d45b7d598b73352f31416cd7d14bbb50"} May 21 18:16:01.414542 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:01.414542 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f797b8564-xnzdb" event={"ID":"cd0bb322-8104-4cdf-b79f-1a5eed62f559","Type":"ContainerStarted","Data":"19d4de7bd8c9fe028eb9ddf4bb85c4619e73b925161a29f8b11c45d35e16d455"} May 21 18:16:01.418883 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:01.418845 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:01.423142 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:01.423096 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:01.431895 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:01.431576 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7f797b8564-xnzdb" podStartSLOduration=33.43155839 podStartE2EDuration="33.43155839s" podCreationTimestamp="2026-05-21 18:15:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:16:01.430627896 +0000 UTC m=+130.994719160" watchObservedRunningTime="2026-05-21 18:16:01.43155839 +0000 UTC m=+130.995649653" May 21 18:16:02.418262 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:02.418229 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:02.419948 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:02.419927 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f797b8564-xnzdb" May 21 18:16:02.925537 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:02.925500 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq"] May 21 18:16:02.927596 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:02.927572 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" May 21 18:16:02.929953 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:02.929933 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pkc5p\"" May 21 18:16:02.930076 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:02.929983 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 18:16:02.936365 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:02.936332 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq"] May 21 18:16:02.975291 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:02.975257 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62496169-eb04-4977-a853-2284db734f9a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq\" (UID: \"62496169-eb04-4977-a853-2284db734f9a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" May 21 18:16:03.076103 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.076060 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62496169-eb04-4977-a853-2284db734f9a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq\" (UID: \"62496169-eb04-4977-a853-2284db734f9a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" May 21 18:16:03.078561 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.078537 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62496169-eb04-4977-a853-2284db734f9a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq\" (UID: \"62496169-eb04-4977-a853-2284db734f9a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" May 21 18:16:03.236577 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.236540 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" May 21 18:16:03.361099 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.361075 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq"] May 21 18:16:03.363338 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:03.363312 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62496169_eb04_4977_a853_2284db734f9a.slice/crio-51452645d9f259267ba79f954b2cfcbf8dc43b0ef33f867a5d766a999d10e163 WatchSource:0}: Error finding container 51452645d9f259267ba79f954b2cfcbf8dc43b0ef33f867a5d766a999d10e163: Status 404 returned error can't find the container with id 51452645d9f259267ba79f954b2cfcbf8dc43b0ef33f867a5d766a999d10e163 May 21 18:16:03.422048 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.422003 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b8mgd" event={"ID":"4e102289-f8a8-475e-8f4e-422e0a01eed3","Type":"ContainerStarted","Data":"4f455515d526132d88ff52b2a939d448b53d463ce484e390a2e43fd2b4a8e827"} May 21 18:16:03.422048 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.422045 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b8mgd" event={"ID":"4e102289-f8a8-475e-8f4e-422e0a01eed3","Type":"ContainerStarted","Data":"e562d8b4333d79ce15a31760c0ed4b9d944efcd62fbec4506af7b765eae18cc5"} May 21 18:16:03.423374 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.423346 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" event={"ID":"af16bf09-0e98-4f24-9571-f94284be67ee","Type":"ContainerStarted","Data":"c6fa0b166478e957aac8403f15b75b61232aaf90e34d60ea4411a31a9e47e5d3"} May 21 18:16:03.424304 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.424281 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" event={"ID":"62496169-eb04-4977-a853-2284db734f9a","Type":"ContainerStarted","Data":"51452645d9f259267ba79f954b2cfcbf8dc43b0ef33f867a5d766a999d10e163"} May 21 18:16:03.437054 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.437005 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b8mgd" podStartSLOduration=131.003833521 podStartE2EDuration="2m12.436992925s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:16:00.963368197 +0000 UTC m=+130.527459436" lastFinishedPulling="2026-05-21 18:16:02.396527598 +0000 UTC m=+131.960618840" observedRunningTime="2026-05-21 18:16:03.436417907 +0000 UTC m=+133.000509169" watchObservedRunningTime="2026-05-21 18:16:03.436992925 +0000 UTC m=+133.001084182" May 21 18:16:03.452655 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:03.452602 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-7skkw" podStartSLOduration=33.434439471 podStartE2EDuration="35.452587486s" podCreationTimestamp="2026-05-21 18:15:28 +0000 UTC" firstStartedPulling="2026-05-21 18:16:00.381049303 +0000 UTC m=+129.945140545" lastFinishedPulling="2026-05-21 18:16:02.399197317 +0000 UTC m=+131.963288560" observedRunningTime="2026-05-21 18:16:03.45163047 +0000 UTC m=+133.015721731" watchObservedRunningTime="2026-05-21 18:16:03.452587486 +0000 UTC m=+133.016678791" May 21 18:16:05.366494 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:05.366453 2555 patch_prober.go:28] interesting pod/image-registry-6f4555f475-tqm5j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 18:16:05.366958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:05.366514 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" podUID="698fb556-3195-4931-807b-2159a1630cc2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 18:16:05.431186 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:05.431150 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" event={"ID":"62496169-eb04-4977-a853-2284db734f9a","Type":"ContainerStarted","Data":"43ae86828c4f51e508eae0bfabfcb0af5dc28f39cbd15ff19ea0dc4e95ff85b0"} May 21 18:16:05.431375 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:05.431353 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" May 21 18:16:05.435973 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:05.435949 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" May 21 18:16:05.447176 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:05.447132 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq" podStartSLOduration=2.325795503 podStartE2EDuration="3.447101851s" podCreationTimestamp="2026-05-21 18:16:02 +0000 UTC" firstStartedPulling="2026-05-21 18:16:03.36533725 +0000 UTC m=+132.929428491" lastFinishedPulling="2026-05-21 18:16:04.486643587 +0000 UTC m=+134.050734839" observedRunningTime="2026-05-21 18:16:05.444907311 +0000 UTC m=+135.008998583" watchObservedRunningTime="2026-05-21 18:16:05.447101851 +0000 UTC m=+135.011193112" May 21 18:16:05.989651 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:05.989618 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg"] May 21 18:16:06.005316 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.005288 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg"] May 21 18:16:06.005467 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.005408 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.007920 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.007899 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 18:16:06.008760 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.008738 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 18:16:06.008892 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.008777 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 18:16:06.008892 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.008847 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7qrbp\"" May 21 18:16:06.102008 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.101967 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d5efd72-e838-49b4-8be3-f7e688e49b66-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.102214 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.102045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.102214 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.102076 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp7h7\" (UniqueName: \"kubernetes.io/projected/7d5efd72-e838-49b4-8be3-f7e688e49b66-kube-api-access-dp7h7\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.102214 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.102126 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.202964 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.202922 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d5efd72-e838-49b4-8be3-f7e688e49b66-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.203174 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.202988 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.203174 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.203015 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dp7h7\" (UniqueName: \"kubernetes.io/projected/7d5efd72-e838-49b4-8be3-f7e688e49b66-kube-api-access-dp7h7\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.203174 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.203045 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.203350 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:16:06.203184 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 21 18:16:06.203350 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:16:06.203261 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-tls podName:7d5efd72-e838-49b4-8be3-f7e688e49b66 nodeName:}" failed. No retries permitted until 2026-05-21 18:16:06.70324104 +0000 UTC m=+136.267332294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-n5vtg" (UID: "7d5efd72-e838-49b4-8be3-f7e688e49b66") : secret "prometheus-operator-tls" not found May 21 18:16:06.203613 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.203589 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d5efd72-e838-49b4-8be3-f7e688e49b66-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.205468 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.205443 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.213392 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.213366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp7h7\" (UniqueName: \"kubernetes.io/projected/7d5efd72-e838-49b4-8be3-f7e688e49b66-kube-api-access-dp7h7\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.707094 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.707048 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.709361 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.709341 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d5efd72-e838-49b4-8be3-f7e688e49b66-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-n5vtg\" (UID: \"7d5efd72-e838-49b4-8be3-f7e688e49b66\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:06.915131 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:06.915072 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" May 21 18:16:07.035757 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:07.035728 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg"] May 21 18:16:07.038367 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:07.038345 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5efd72_e838_49b4_8be3_f7e688e49b66.slice/crio-7f18a48a5e959f209e579d312c09f216cd178c5dbe43ef87a60bbd11eb6d3fd0 WatchSource:0}: Error finding container 7f18a48a5e959f209e579d312c09f216cd178c5dbe43ef87a60bbd11eb6d3fd0: Status 404 returned error can't find the container with id 7f18a48a5e959f209e579d312c09f216cd178c5dbe43ef87a60bbd11eb6d3fd0 May 21 18:16:07.437317 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:07.437283 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" event={"ID":"7d5efd72-e838-49b4-8be3-f7e688e49b66","Type":"ContainerStarted","Data":"7f18a48a5e959f209e579d312c09f216cd178c5dbe43ef87a60bbd11eb6d3fd0"} May 21 18:16:08.442841 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:08.442807 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" event={"ID":"7d5efd72-e838-49b4-8be3-f7e688e49b66","Type":"ContainerStarted","Data":"6168b669718ad4f44ad9f41f6977037dde643ff10c81fb6c9c04e2321a521f6d"} May 21 18:16:08.442841 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:08.442844 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" event={"ID":"7d5efd72-e838-49b4-8be3-f7e688e49b66","Type":"ContainerStarted","Data":"60c6fcde6139958a20fa142636bf472ccbb0143afcafaf8ebe5e7b7110cf79ca"} May 21 18:16:08.457757 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:08.457700 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-n5vtg" podStartSLOduration=2.192845044 podStartE2EDuration="3.457685093s" podCreationTimestamp="2026-05-21 18:16:05 +0000 UTC" firstStartedPulling="2026-05-21 18:16:07.040255395 +0000 UTC m=+136.604346634" lastFinishedPulling="2026-05-21 18:16:08.305095444 +0000 UTC m=+137.869186683" observedRunningTime="2026-05-21 18:16:08.456690336 +0000 UTC m=+138.020781597" watchObservedRunningTime="2026-05-21 18:16:08.457685093 +0000 UTC m=+138.021776353" May 21 18:16:10.017091 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.017053 2555 scope.go:117] "RemoveContainer" containerID="8720266f7bb2ae64628a99941486fc98ce32f403ce99eea38b0e835365f73956" May 21 18:16:10.017579 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:16:10.017361 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-4jwdp_openshift-console-operator(bb32b748-2aa4-49af-aa2a-75f4bd4a20e2)\"" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" podUID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" May 21 18:16:10.330184 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.330086 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-llg4s"] May 21 18:16:10.332614 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.332591 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.335389 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.335356 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 18:16:10.335509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.335387 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vpjw5\"" May 21 18:16:10.335509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.335496 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 18:16:10.335654 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.335636 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 18:16:10.336040 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.336018 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55"] May 21 18:16:10.338697 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.338677 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.341118 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.341084 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ff2d2\"" May 21 18:16:10.341183 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.341130 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 18:16:10.341241 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.341194 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 18:16:10.341281 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.341265 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 18:16:10.352064 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.352035 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55"] May 21 18:16:10.436918 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.436880 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.436918 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.436916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-tls\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.437234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.436976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.437234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.437234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-root\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.437234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437055 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pdfb\" (UniqueName: \"kubernetes.io/projected/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-api-access-8pdfb\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.437234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437134 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17d5962a-b8de-457a-8094-df004dcabdf0-metrics-client-ca\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.437234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437179 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917a4780-e548-4ea4-9024-e9ed09cc4409-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.437234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4bhr\" (UniqueName: \"kubernetes.io/projected/17d5962a-b8de-457a-8094-df004dcabdf0-kube-api-access-p4bhr\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.437540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437248 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/917a4780-e548-4ea4-9024-e9ed09cc4409-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.437540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437278 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.437540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437329 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-textfile\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.437540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437370 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-wtmp\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.437540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-sys\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.437540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.437431 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.537906 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.537869 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-wtmp\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538072 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.537918 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-sys\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538072 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.537944 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538072 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.537987 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.538072 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538007 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-tls\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538072 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538054 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-sys\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538292 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538054 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-wtmp\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538292 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538150 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.538292 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538192 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.538292 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538223 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-root\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538292 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538252 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pdfb\" (UniqueName: \"kubernetes.io/projected/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-api-access-8pdfb\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.538526 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:16:10.538293 2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 21 18:16:10.538526 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17d5962a-b8de-457a-8094-df004dcabdf0-root\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538526 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:16:10.538361 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-tls podName:917a4780-e548-4ea4-9024-e9ed09cc4409 nodeName:}" failed. No retries permitted until 2026-05-21 18:16:11.038342556 +0000 UTC m=+140.602433796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-98k55" (UID: "917a4780-e548-4ea4-9024-e9ed09cc4409") : secret "kube-state-metrics-tls" not found May 21 18:16:10.538526 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538422 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17d5962a-b8de-457a-8094-df004dcabdf0-metrics-client-ca\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538526 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538478 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917a4780-e548-4ea4-9024-e9ed09cc4409-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.538526 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538525 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4bhr\" (UniqueName: \"kubernetes.io/projected/17d5962a-b8de-457a-8094-df004dcabdf0-kube-api-access-p4bhr\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538879 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538556 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/917a4780-e548-4ea4-9024-e9ed09cc4409-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.538879 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538596 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538879 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538629 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-textfile\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.538879 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538831 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.539077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.538995 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17d5962a-b8de-457a-8094-df004dcabdf0-metrics-client-ca\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.539077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.539013 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-textfile\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.539191 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.539167 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/917a4780-e548-4ea4-9024-e9ed09cc4409-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.539413 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.539391 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917a4780-e548-4ea4-9024-e9ed09cc4409-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.539480 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.539466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.540637 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.540604 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.540956 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.540929 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-tls\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.541073 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.540938 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17d5962a-b8de-457a-8094-df004dcabdf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.552352 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.552328 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4bhr\" (UniqueName: \"kubernetes.io/projected/17d5962a-b8de-457a-8094-df004dcabdf0-kube-api-access-p4bhr\") pod \"node-exporter-llg4s\" (UID: \"17d5962a-b8de-457a-8094-df004dcabdf0\") " pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.552720 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.552704 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pdfb\" (UniqueName: \"kubernetes.io/projected/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-api-access-8pdfb\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:10.643292 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:10.643221 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llg4s" May 21 18:16:10.651204 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:10.651169 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d5962a_b8de_457a_8094_df004dcabdf0.slice/crio-d41f2efdfbb8a3b1f523f38d8e248131176c800ab6dc814f54eb9c5af816e4ac WatchSource:0}: Error finding container d41f2efdfbb8a3b1f523f38d8e248131176c800ab6dc814f54eb9c5af816e4ac: Status 404 returned error can't find the container with id d41f2efdfbb8a3b1f523f38d8e248131176c800ab6dc814f54eb9c5af816e4ac May 21 18:16:11.043659 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:11.043618 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:11.046327 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:11.046302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/917a4780-e548-4ea4-9024-e9ed09cc4409-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-98k55\" (UID: \"917a4780-e548-4ea4-9024-e9ed09cc4409\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:11.249565 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:11.249534 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" May 21 18:16:11.406024 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:11.405967 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55"] May 21 18:16:11.459802 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:11.459759 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llg4s" event={"ID":"17d5962a-b8de-457a-8094-df004dcabdf0","Type":"ContainerStarted","Data":"d41f2efdfbb8a3b1f523f38d8e248131176c800ab6dc814f54eb9c5af816e4ac"} May 21 18:16:11.506431 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:11.506393 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917a4780_e548_4ea4_9024_e9ed09cc4409.slice/crio-43c72afe21b797aceecd6786a812dfe064ab30f20f790335e2266843f38524e8 WatchSource:0}: Error finding container 43c72afe21b797aceecd6786a812dfe064ab30f20f790335e2266843f38524e8: Status 404 returned error can't find the container with id 43c72afe21b797aceecd6786a812dfe064ab30f20f790335e2266843f38524e8 May 21 18:16:12.464218 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:12.464178 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" event={"ID":"917a4780-e548-4ea4-9024-e9ed09cc4409","Type":"ContainerStarted","Data":"43c72afe21b797aceecd6786a812dfe064ab30f20f790335e2266843f38524e8"} May 21 18:16:12.465907 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:12.465869 2555 generic.go:358] "Generic (PLEG): container finished" podID="17d5962a-b8de-457a-8094-df004dcabdf0" containerID="94bd317c2fce53245352b644f317293fb015d6b7024d6f7b384c2fb22492c432" exitCode=0 May 21 18:16:12.466034 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:12.465913 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llg4s" event={"ID":"17d5962a-b8de-457a-8094-df004dcabdf0","Type":"ContainerDied","Data":"94bd317c2fce53245352b644f317293fb015d6b7024d6f7b384c2fb22492c432"} May 21 18:16:13.470686 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:13.470641 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" event={"ID":"917a4780-e548-4ea4-9024-e9ed09cc4409","Type":"ContainerStarted","Data":"cc340be2998789a46cdbd3969c0d708bb55ea001f78f2087bfbcf6a30994426b"} May 21 18:16:13.470686 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:13.470686 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" event={"ID":"917a4780-e548-4ea4-9024-e9ed09cc4409","Type":"ContainerStarted","Data":"5b78697769b700f2750aaa7f99bfebb7c08b33cc198f798e1cebf725a924ef60"} May 21 18:16:13.470686 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:13.470696 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" event={"ID":"917a4780-e548-4ea4-9024-e9ed09cc4409","Type":"ContainerStarted","Data":"87fc4f9ebbe4417cf036495e5ad48309dc66d40c1fcbdae25cbd93b444d8c793"} May 21 18:16:13.472795 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:13.472763 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llg4s" event={"ID":"17d5962a-b8de-457a-8094-df004dcabdf0","Type":"ContainerStarted","Data":"80e9536adc9adc6731c39b37d21935a4b776af1e4b89a63559ca813371bbc477"} May 21 18:16:13.472916 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:13.472804 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llg4s" event={"ID":"17d5962a-b8de-457a-8094-df004dcabdf0","Type":"ContainerStarted","Data":"c1f7bcce25126d96a4d01d52577077cafb584ee224be9d9e348f5dba3c739ba3"} May 21 18:16:13.489457 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:13.489408 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-98k55" podStartSLOduration=2.256907957 podStartE2EDuration="3.489394707s" podCreationTimestamp="2026-05-21 18:16:10 +0000 UTC" firstStartedPulling="2026-05-21 18:16:11.508597728 +0000 UTC m=+141.072688970" lastFinishedPulling="2026-05-21 18:16:12.741084481 +0000 UTC m=+142.305175720" observedRunningTime="2026-05-21 18:16:13.487188945 +0000 UTC m=+143.051280219" watchObservedRunningTime="2026-05-21 18:16:13.489394707 +0000 UTC m=+143.053485968" May 21 18:16:13.507524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:13.507471 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-llg4s" podStartSLOduration=2.624589178 podStartE2EDuration="3.50745487s" podCreationTimestamp="2026-05-21 18:16:10 +0000 UTC" firstStartedPulling="2026-05-21 18:16:10.652886808 +0000 UTC m=+140.216978046" lastFinishedPulling="2026-05-21 18:16:11.535752498 +0000 UTC m=+141.099843738" observedRunningTime="2026-05-21 18:16:13.50617919 +0000 UTC m=+143.070270450" watchObservedRunningTime="2026-05-21 18:16:13.50745487 +0000 UTC m=+143.071546128" May 21 18:16:15.106866 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.106831 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl"] May 21 18:16:15.110360 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.110329 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" May 21 18:16:15.113369 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.113340 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 18:16:15.113493 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.113369 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-rxfcz\"" May 21 18:16:15.120791 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.120768 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl"] May 21 18:16:15.181001 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.180965 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d12c3ec0-ace1-4642-b84a-fcd98bceac54-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-ktmhl\" (UID: \"d12c3ec0-ace1-4642-b84a-fcd98bceac54\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" May 21 18:16:15.282416 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.282377 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d12c3ec0-ace1-4642-b84a-fcd98bceac54-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-ktmhl\" (UID: \"d12c3ec0-ace1-4642-b84a-fcd98bceac54\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" May 21 18:16:15.284791 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.284760 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d12c3ec0-ace1-4642-b84a-fcd98bceac54-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-ktmhl\" (UID: \"d12c3ec0-ace1-4642-b84a-fcd98bceac54\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" May 21 18:16:15.365730 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.365657 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:16:15.422380 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.422351 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" May 21 18:16:15.554757 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:15.554724 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl"] May 21 18:16:15.559814 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:15.559781 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12c3ec0_ace1_4642_b84a_fcd98bceac54.slice/crio-819295910d4c36f95e44be9abd13a0f02188c76b6275362c6766fcace2c95859 WatchSource:0}: Error finding container 819295910d4c36f95e44be9abd13a0f02188c76b6275362c6766fcace2c95859: Status 404 returned error can't find the container with id 819295910d4c36f95e44be9abd13a0f02188c76b6275362c6766fcace2c95859 May 21 18:16:16.483530 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:16.483495 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" event={"ID":"d12c3ec0-ace1-4642-b84a-fcd98bceac54","Type":"ContainerStarted","Data":"819295910d4c36f95e44be9abd13a0f02188c76b6275362c6766fcace2c95859"} May 21 18:16:17.487676 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:17.487639 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" event={"ID":"d12c3ec0-ace1-4642-b84a-fcd98bceac54","Type":"ContainerStarted","Data":"fac5716538ab76ca1eb05f9c6e47867d6e3a4838b0c1ba82fa6c4e95e0c69dbd"} May 21 18:16:17.488064 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:17.487797 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" May 21 18:16:17.492470 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:17.492446 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" May 21 18:16:17.501258 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:17.501181 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ktmhl" podStartSLOduration=1.064579342 podStartE2EDuration="2.501164518s" podCreationTimestamp="2026-05-21 18:16:15 +0000 UTC" firstStartedPulling="2026-05-21 18:16:15.561613159 +0000 UTC m=+145.125704402" lastFinishedPulling="2026-05-21 18:16:16.998198325 +0000 UTC m=+146.562289578" observedRunningTime="2026-05-21 18:16:17.500726974 +0000 UTC m=+147.064818236" watchObservedRunningTime="2026-05-21 18:16:17.501164518 +0000 UTC m=+147.065255780" May 21 18:16:20.380475 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.380427 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" podUID="698fb556-3195-4931-807b-2159a1630cc2" containerName="registry" containerID="cri-o://97006c15df9e81d7ee2529fde87a242ae547ceae13378d7d1ddb8eebee8d6b50" gracePeriod=30 May 21 18:16:20.496941 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.496913 2555 generic.go:358] "Generic (PLEG): container finished" podID="698fb556-3195-4931-807b-2159a1630cc2" containerID="97006c15df9e81d7ee2529fde87a242ae547ceae13378d7d1ddb8eebee8d6b50" exitCode=0 May 21 18:16:20.497055 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.496957 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" event={"ID":"698fb556-3195-4931-807b-2159a1630cc2","Type":"ContainerDied","Data":"97006c15df9e81d7ee2529fde87a242ae547ceae13378d7d1ddb8eebee8d6b50"} May 21 18:16:20.616294 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.616267 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:16:20.730580 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.730554 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-installation-pull-secrets\") pod \"698fb556-3195-4931-807b-2159a1630cc2\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " May 21 18:16:20.730759 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.730612 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") pod \"698fb556-3195-4931-807b-2159a1630cc2\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " May 21 18:16:20.730759 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.730639 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-bound-sa-token\") pod \"698fb556-3195-4931-807b-2159a1630cc2\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " May 21 18:16:20.730759 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.730663 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-image-registry-private-configuration\") pod \"698fb556-3195-4931-807b-2159a1630cc2\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " May 21 18:16:20.730759 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.730694 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-registry-certificates\") pod \"698fb556-3195-4931-807b-2159a1630cc2\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " May 21 18:16:20.730759 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.730735 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-trusted-ca\") pod \"698fb556-3195-4931-807b-2159a1630cc2\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " May 21 18:16:20.731001 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.730783 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/698fb556-3195-4931-807b-2159a1630cc2-ca-trust-extracted\") pod \"698fb556-3195-4931-807b-2159a1630cc2\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " May 21 18:16:20.731001 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.730823 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6ss8\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-kube-api-access-x6ss8\") pod \"698fb556-3195-4931-807b-2159a1630cc2\" (UID: \"698fb556-3195-4931-807b-2159a1630cc2\") " May 21 18:16:20.731211 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.731151 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "698fb556-3195-4931-807b-2159a1630cc2" (UID: "698fb556-3195-4931-807b-2159a1630cc2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:16:20.731446 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.731392 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "698fb556-3195-4931-807b-2159a1630cc2" (UID: "698fb556-3195-4931-807b-2159a1630cc2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:16:20.733015 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.732989 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "698fb556-3195-4931-807b-2159a1630cc2" (UID: "698fb556-3195-4931-807b-2159a1630cc2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:16:20.733298 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.733269 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "698fb556-3195-4931-807b-2159a1630cc2" (UID: "698fb556-3195-4931-807b-2159a1630cc2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:16:20.733391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.733297 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "698fb556-3195-4931-807b-2159a1630cc2" (UID: "698fb556-3195-4931-807b-2159a1630cc2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:16:20.733391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.733326 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "698fb556-3195-4931-807b-2159a1630cc2" (UID: "698fb556-3195-4931-807b-2159a1630cc2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:16:20.733471 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.733407 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-kube-api-access-x6ss8" (OuterVolumeSpecName: "kube-api-access-x6ss8") pod "698fb556-3195-4931-807b-2159a1630cc2" (UID: "698fb556-3195-4931-807b-2159a1630cc2"). InnerVolumeSpecName "kube-api-access-x6ss8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:16:20.739322 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.739300 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698fb556-3195-4931-807b-2159a1630cc2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "698fb556-3195-4931-807b-2159a1630cc2" (UID: "698fb556-3195-4931-807b-2159a1630cc2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:16:20.831683 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.831645 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/698fb556-3195-4931-807b-2159a1630cc2-ca-trust-extracted\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:16:20.831683 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.831676 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6ss8\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-kube-api-access-x6ss8\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:16:20.831683 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.831686 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-installation-pull-secrets\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:16:20.831885 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.831695 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-registry-tls\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:16:20.831885 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.831704 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/698fb556-3195-4931-807b-2159a1630cc2-bound-sa-token\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:16:20.831885 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.831713 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/698fb556-3195-4931-807b-2159a1630cc2-image-registry-private-configuration\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:16:20.831885 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.831721 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-registry-certificates\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:16:20.831885 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:20.831731 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/698fb556-3195-4931-807b-2159a1630cc2-trusted-ca\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:16:21.500617 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:21.500585 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" event={"ID":"698fb556-3195-4931-807b-2159a1630cc2","Type":"ContainerDied","Data":"5bcf99f1d4a4741ffb9a4e3f1b80a55917d9575cc8749574b73a7fb1c73715ab"} May 21 18:16:21.500617 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:21.500615 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f4555f475-tqm5j" May 21 18:16:21.501085 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:21.500631 2555 scope.go:117] "RemoveContainer" containerID="97006c15df9e81d7ee2529fde87a242ae547ceae13378d7d1ddb8eebee8d6b50" May 21 18:16:21.517156 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:21.517099 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f4555f475-tqm5j"] May 21 18:16:21.518059 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:21.518031 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f4555f475-tqm5j"] May 21 18:16:23.021748 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:23.021266 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="698fb556-3195-4931-807b-2159a1630cc2" path="/var/lib/kubelet/pods/698fb556-3195-4931-807b-2159a1630cc2/volumes" May 21 18:16:24.017072 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:24.017042 2555 scope.go:117] "RemoveContainer" containerID="8720266f7bb2ae64628a99941486fc98ce32f403ce99eea38b0e835365f73956" May 21 18:16:24.512725 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:24.512695 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:16:24.513123 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:24.512817 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" event={"ID":"bb32b748-2aa4-49af-aa2a-75f4bd4a20e2","Type":"ContainerStarted","Data":"0ad5a197d3228656838c2d46f1a6dbe2b7123db2bd31fdd4ec1a43aef19d6658"} May 21 18:16:24.513194 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:24.513150 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:16:24.528292 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:24.528236 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" podStartSLOduration=53.901828591 podStartE2EDuration="57.528221145s" podCreationTimestamp="2026-05-21 18:15:27 +0000 UTC" firstStartedPulling="2026-05-21 18:15:28.445474467 +0000 UTC m=+98.009565707" lastFinishedPulling="2026-05-21 18:15:32.071867021 +0000 UTC m=+101.635958261" observedRunningTime="2026-05-21 18:16:24.527199088 +0000 UTC m=+154.091290348" watchObservedRunningTime="2026-05-21 18:16:24.528221145 +0000 UTC m=+154.092312407" May 21 18:16:25.513863 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.513808 2555 patch_prober.go:28] interesting pod/console-operator-76dff48d59-4jwdp container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.7:8443/readyz\": context deadline exceeded" start-of-body= May 21 18:16:25.514324 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.513875 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" podUID="bb32b748-2aa4-49af-aa2a-75f4bd4a20e2" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.7:8443/readyz\": context deadline exceeded" May 21 18:16:25.703465 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.703436 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-4jwdp" May 21 18:16:25.874547 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.874462 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-tp8pr"] May 21 18:16:25.874846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.874829 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698fb556-3195-4931-807b-2159a1630cc2" containerName="registry" May 21 18:16:25.874930 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.874849 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="698fb556-3195-4931-807b-2159a1630cc2" containerName="registry" May 21 18:16:25.874930 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.874917 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="698fb556-3195-4931-807b-2159a1630cc2" containerName="registry" May 21 18:16:25.876859 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.876837 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-tp8pr" May 21 18:16:25.880568 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.880540 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 18:16:25.880662 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.880544 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 18:16:25.880662 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.880650 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gj8bp\"" May 21 18:16:25.886471 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.886450 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-tp8pr"] May 21 18:16:25.978470 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:25.978441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p5r9\" (UniqueName: \"kubernetes.io/projected/8fa407f3-0ab6-49e8-a914-93656a5adab6-kube-api-access-5p5r9\") pod \"downloads-57bd96b888-tp8pr\" (UID: \"8fa407f3-0ab6-49e8-a914-93656a5adab6\") " pod="openshift-console/downloads-57bd96b888-tp8pr" May 21 18:16:26.078926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:26.078886 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5p5r9\" (UniqueName: \"kubernetes.io/projected/8fa407f3-0ab6-49e8-a914-93656a5adab6-kube-api-access-5p5r9\") pod \"downloads-57bd96b888-tp8pr\" (UID: \"8fa407f3-0ab6-49e8-a914-93656a5adab6\") " pod="openshift-console/downloads-57bd96b888-tp8pr" May 21 18:16:26.087872 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:26.087840 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p5r9\" (UniqueName: \"kubernetes.io/projected/8fa407f3-0ab6-49e8-a914-93656a5adab6-kube-api-access-5p5r9\") pod \"downloads-57bd96b888-tp8pr\" (UID: \"8fa407f3-0ab6-49e8-a914-93656a5adab6\") " pod="openshift-console/downloads-57bd96b888-tp8pr" May 21 18:16:26.186603 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:26.186512 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-tp8pr" May 21 18:16:26.316084 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:26.316061 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-tp8pr"] May 21 18:16:26.318270 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:26.318235 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa407f3_0ab6_49e8_a914_93656a5adab6.slice/crio-bb2ad62a58999eaab02d7e8d65368656b560d270f93c9284f3ef5971ee6207dc WatchSource:0}: Error finding container bb2ad62a58999eaab02d7e8d65368656b560d270f93c9284f3ef5971ee6207dc: Status 404 returned error can't find the container with id bb2ad62a58999eaab02d7e8d65368656b560d270f93c9284f3ef5971ee6207dc May 21 18:16:26.520182 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:26.520147 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-tp8pr" event={"ID":"8fa407f3-0ab6-49e8-a914-93656a5adab6","Type":"ContainerStarted","Data":"bb2ad62a58999eaab02d7e8d65368656b560d270f93c9284f3ef5971ee6207dc"} May 21 18:16:30.814348 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:16:30.814300 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ml5nd" podUID="c054bab1-a1e6-4166-afe9-c02f7cf4a0bd" May 21 18:16:30.821366 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:16:30.821332 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-rqs4r" podUID="0e84d92d-02a2-436b-a0dd-92d3d7891a7b" May 21 18:16:31.536765 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:31.536726 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ml5nd" May 21 18:16:35.766914 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:35.766863 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:16:35.767379 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:35.766967 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:16:35.770229 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:35.770185 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c054bab1-a1e6-4166-afe9-c02f7cf4a0bd-metrics-tls\") pod \"dns-default-ml5nd\" (UID: \"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd\") " pod="openshift-dns/dns-default-ml5nd" May 21 18:16:35.770229 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:35.770226 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e84d92d-02a2-436b-a0dd-92d3d7891a7b-cert\") pod \"ingress-canary-rqs4r\" (UID: \"0e84d92d-02a2-436b-a0dd-92d3d7891a7b\") " pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:16:36.040410 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.040327 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8zgcw\"" May 21 18:16:36.048713 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.048686 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ml5nd" May 21 18:16:36.210385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.210299 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ml5nd"] May 21 18:16:36.213630 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:36.213604 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc054bab1_a1e6_4166_afe9_c02f7cf4a0bd.slice/crio-89aa0299725a0b98611d0bd51ccc0618e9cecc14da79a59f2fc856f6ef3d924f WatchSource:0}: Error finding container 89aa0299725a0b98611d0bd51ccc0618e9cecc14da79a59f2fc856f6ef3d924f: Status 404 returned error can't find the container with id 89aa0299725a0b98611d0bd51ccc0618e9cecc14da79a59f2fc856f6ef3d924f May 21 18:16:36.552705 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.552675 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ml5nd" event={"ID":"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd","Type":"ContainerStarted","Data":"89aa0299725a0b98611d0bd51ccc0618e9cecc14da79a59f2fc856f6ef3d924f"} May 21 18:16:36.799210 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.799168 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b878bcf8d-lpqn7"] May 21 18:16:36.801724 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.801696 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.804041 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.803982 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 18:16:36.804041 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.803989 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 18:16:36.805307 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.805145 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bsqgb\"" May 21 18:16:36.805307 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.805164 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 18:16:36.805307 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.805192 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 18:16:36.805516 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.805459 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 18:16:36.810552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.810528 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b878bcf8d-lpqn7"] May 21 18:16:36.877771 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.877731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-serving-cert\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.877957 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.877789 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-oauth-config\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.877957 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.877895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-service-ca\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.877957 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.877948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-console-config\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.878098 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.877986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-oauth-serving-cert\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.878098 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.878016 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-727q9\" (UniqueName: \"kubernetes.io/projected/1dbe72e3-1f99-4a49-83e2-746986579225-kube-api-access-727q9\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.978744 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.978579 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-service-ca\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.978744 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.978657 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-console-config\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.978744 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.978695 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-oauth-serving-cert\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.978744 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.978722 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-727q9\" (UniqueName: \"kubernetes.io/projected/1dbe72e3-1f99-4a49-83e2-746986579225-kube-api-access-727q9\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.979186 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.978775 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-serving-cert\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.979186 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.978808 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-oauth-config\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.979514 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.979452 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-oauth-serving-cert\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.979514 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.979469 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-console-config\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.979514 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.979510 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-service-ca\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.982256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.982228 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-oauth-config\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.982425 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.982400 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-serving-cert\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:36.994410 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:36.993879 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-727q9\" (UniqueName: \"kubernetes.io/projected/1dbe72e3-1f99-4a49-83e2-746986579225-kube-api-access-727q9\") pod \"console-b878bcf8d-lpqn7\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:37.115069 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:37.114970 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:37.262781 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:37.262746 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b878bcf8d-lpqn7"] May 21 18:16:37.265839 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:16:37.265801 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbe72e3_1f99_4a49_83e2_746986579225.slice/crio-788e23873ada4359c919113fccd949c20afd051109c97ebcd0f287c2e34e44e1 WatchSource:0}: Error finding container 788e23873ada4359c919113fccd949c20afd051109c97ebcd0f287c2e34e44e1: Status 404 returned error can't find the container with id 788e23873ada4359c919113fccd949c20afd051109c97ebcd0f287c2e34e44e1 May 21 18:16:37.557570 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:37.557518 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b878bcf8d-lpqn7" event={"ID":"1dbe72e3-1f99-4a49-83e2-746986579225","Type":"ContainerStarted","Data":"788e23873ada4359c919113fccd949c20afd051109c97ebcd0f287c2e34e44e1"} May 21 18:16:38.562421 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:38.562378 2555 generic.go:358] "Generic (PLEG): container finished" podID="c35f900f-5f12-42bf-b03c-7648b91407e4" containerID="cc4c15a63bcb4d49a3d9943f1d2c6c4e34a57b2cd37970c08ff8c9388091af08" exitCode=0 May 21 18:16:38.562872 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:38.562504 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" event={"ID":"c35f900f-5f12-42bf-b03c-7648b91407e4","Type":"ContainerDied","Data":"cc4c15a63bcb4d49a3d9943f1d2c6c4e34a57b2cd37970c08ff8c9388091af08"} May 21 18:16:38.562941 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:38.562872 2555 scope.go:117] "RemoveContainer" containerID="cc4c15a63bcb4d49a3d9943f1d2c6c4e34a57b2cd37970c08ff8c9388091af08" May 21 18:16:39.391648 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.391611 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7cf65588-w2xlk"] May 21 18:16:39.394176 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.394143 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.401563 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.401365 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 18:16:39.403449 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.403426 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7cf65588-w2xlk"] May 21 18:16:39.502974 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.502937 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-oauth-serving-cert\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.503166 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.502999 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-service-ca\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.503166 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.503026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-trusted-ca-bundle\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.503166 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.503149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8h49\" (UniqueName: \"kubernetes.io/projected/055be9e0-494f-41f3-9fb0-274570789f0f-kube-api-access-z8h49\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.503309 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.503188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-serving-cert\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.503309 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.503220 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-oauth-config\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.503309 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.503272 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-console-config\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.604623 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.604577 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-oauth-serving-cert\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605127 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.604634 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-service-ca\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605127 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.604653 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-trusted-ca-bundle\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605127 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.604682 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8h49\" (UniqueName: \"kubernetes.io/projected/055be9e0-494f-41f3-9fb0-274570789f0f-kube-api-access-z8h49\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605127 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.604699 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-serving-cert\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605127 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.604726 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-oauth-config\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605414 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.605249 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-console-config\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605470 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.605441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-oauth-serving-cert\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605527 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.605441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-service-ca\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.605972 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.605947 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-trusted-ca-bundle\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.606082 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.605957 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-console-config\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.607483 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.607462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-serving-cert\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.607650 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.607570 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-oauth-config\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.612393 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.612366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8h49\" (UniqueName: \"kubernetes.io/projected/055be9e0-494f-41f3-9fb0-274570789f0f-kube-api-access-z8h49\") pod \"console-6d7cf65588-w2xlk\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:39.705916 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:39.705825 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:43.016596 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:43.016557 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:16:43.019407 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:43.019371 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xmgqj\"" May 21 18:16:43.027370 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:43.027339 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqs4r" May 21 18:16:46.084046 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.083620 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqs4r"] May 21 18:16:46.116215 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.116175 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7cf65588-w2xlk"] May 21 18:16:46.591828 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.591785 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b878bcf8d-lpqn7" event={"ID":"1dbe72e3-1f99-4a49-83e2-746986579225","Type":"ContainerStarted","Data":"8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da"} May 21 18:16:46.594599 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.594567 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqs4r" event={"ID":"0e84d92d-02a2-436b-a0dd-92d3d7891a7b","Type":"ContainerStarted","Data":"11fa641743db3a6c72f5f7eaf3324c58fd7ec6ad4ca4872763751f92d92da4a5"} May 21 18:16:46.597414 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.597358 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7cf65588-w2xlk" event={"ID":"055be9e0-494f-41f3-9fb0-274570789f0f","Type":"ContainerStarted","Data":"4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0"} May 21 18:16:46.597414 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.597393 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7cf65588-w2xlk" event={"ID":"055be9e0-494f-41f3-9fb0-274570789f0f","Type":"ContainerStarted","Data":"cf209e009de4ad3bb12ff4608b97d36c77462c1cb6efad1f5272c9e6de74c9df"} May 21 18:16:46.599160 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.599134 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-tp8pr" event={"ID":"8fa407f3-0ab6-49e8-a914-93656a5adab6","Type":"ContainerStarted","Data":"213b6d2267c287cf8763d443f9a8ea83fb68a86916a2886164ce24e033af07dd"} May 21 18:16:46.599978 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.599943 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-tp8pr" May 21 18:16:46.602945 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.602893 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ml5nd" event={"ID":"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd","Type":"ContainerStarted","Data":"66a5a2db7aaeb599e06e3a7ae1db5dc284a6a6ae9bea2283d5a6020ac684ffcf"} May 21 18:16:46.602945 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.602920 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ml5nd" event={"ID":"c054bab1-a1e6-4166-afe9-c02f7cf4a0bd","Type":"ContainerStarted","Data":"01a2498186bf0097be2a7529855f748a80e80ec3810c9fd0c45da2b769034983"} May 21 18:16:46.603367 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.603318 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ml5nd" May 21 18:16:46.605978 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.605467 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2rrkp" event={"ID":"c35f900f-5f12-42bf-b03c-7648b91407e4","Type":"ContainerStarted","Data":"358e738746d8a991dd40db6b78b4df9622fe2fee8aedbd696b5fc0e5e3925dbb"} May 21 18:16:46.611526 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.611473 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b878bcf8d-lpqn7" podStartSLOduration=1.913222886 podStartE2EDuration="10.611457737s" podCreationTimestamp="2026-05-21 18:16:36 +0000 UTC" firstStartedPulling="2026-05-21 18:16:37.268356536 +0000 UTC m=+166.832447781" lastFinishedPulling="2026-05-21 18:16:45.966591382 +0000 UTC m=+175.530682632" observedRunningTime="2026-05-21 18:16:46.607683521 +0000 UTC m=+176.171774812" watchObservedRunningTime="2026-05-21 18:16:46.611457737 +0000 UTC m=+176.175548999" May 21 18:16:46.612829 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.612805 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-tp8pr" May 21 18:16:46.626427 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.626374 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d7cf65588-w2xlk" podStartSLOduration=7.626356977 podStartE2EDuration="7.626356977s" podCreationTimestamp="2026-05-21 18:16:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:16:46.623913243 +0000 UTC m=+176.188004503" watchObservedRunningTime="2026-05-21 18:16:46.626356977 +0000 UTC m=+176.190448239" May 21 18:16:46.662578 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.660865 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-ml5nd" podStartSLOduration=129.959194313 podStartE2EDuration="2m19.660845026s" podCreationTimestamp="2026-05-21 18:14:27 +0000 UTC" firstStartedPulling="2026-05-21 18:16:36.215966242 +0000 UTC m=+165.780057486" lastFinishedPulling="2026-05-21 18:16:45.91761695 +0000 UTC m=+175.481708199" observedRunningTime="2026-05-21 18:16:46.659643819 +0000 UTC m=+176.223735081" watchObservedRunningTime="2026-05-21 18:16:46.660845026 +0000 UTC m=+176.224936289" May 21 18:16:46.683832 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:46.683732 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-tp8pr" podStartSLOduration=2.086192585 podStartE2EDuration="21.683561207s" podCreationTimestamp="2026-05-21 18:16:25 +0000 UTC" firstStartedPulling="2026-05-21 18:16:26.32015425 +0000 UTC m=+155.884245490" lastFinishedPulling="2026-05-21 18:16:45.91752287 +0000 UTC m=+175.481614112" observedRunningTime="2026-05-21 18:16:46.68129026 +0000 UTC m=+176.245381557" watchObservedRunningTime="2026-05-21 18:16:46.683561207 +0000 UTC m=+176.247652469" May 21 18:16:47.115210 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:47.115152 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:47.115210 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:47.115214 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:47.122441 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:47.122225 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:47.611569 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:47.611373 2555 generic.go:358] "Generic (PLEG): container finished" podID="d55c7689-dc4f-42f9-a8db-dc3270bb60e8" containerID="69d10389381b44bc3968bdf9c209e486c7d9bd74f886cb609a7b72dd76c8fac1" exitCode=0 May 21 18:16:47.612475 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:47.612443 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-spwhr" event={"ID":"d55c7689-dc4f-42f9-a8db-dc3270bb60e8","Type":"ContainerDied","Data":"69d10389381b44bc3968bdf9c209e486c7d9bd74f886cb609a7b72dd76c8fac1"} May 21 18:16:47.613989 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:47.613706 2555 scope.go:117] "RemoveContainer" containerID="69d10389381b44bc3968bdf9c209e486c7d9bd74f886cb609a7b72dd76c8fac1" May 21 18:16:47.618894 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:47.618870 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:16:48.625916 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:48.624677 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-spwhr" event={"ID":"d55c7689-dc4f-42f9-a8db-dc3270bb60e8","Type":"ContainerStarted","Data":"8ab0b3eabd19e569b6c6c97e7d86e691f1ee9f77130d5206bae13a8505cde4d6"} May 21 18:16:48.631267 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:48.629911 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqs4r" event={"ID":"0e84d92d-02a2-436b-a0dd-92d3d7891a7b","Type":"ContainerStarted","Data":"d01cb6b2f0cfc1d68011502beb4e1237c3f6b2364f3c5dcbfa1cb4919c2bacb7"} May 21 18:16:48.675405 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:48.675189 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rqs4r" podStartSLOduration=139.453575727 podStartE2EDuration="2m21.675167973s" podCreationTimestamp="2026-05-21 18:14:27 +0000 UTC" firstStartedPulling="2026-05-21 18:16:46.098672807 +0000 UTC m=+175.662764059" lastFinishedPulling="2026-05-21 18:16:48.320265049 +0000 UTC m=+177.884356305" observedRunningTime="2026-05-21 18:16:48.674756447 +0000 UTC m=+178.238847700" watchObservedRunningTime="2026-05-21 18:16:48.675167973 +0000 UTC m=+178.239259236" May 21 18:16:49.706615 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:49.706578 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:49.707065 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:49.706633 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:49.711819 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:49.711792 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:49.819154 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:49.819101 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-7skkw_af16bf09-0e98-4f24-9571-f94284be67ee/cluster-monitoring-operator/0.log" May 21 18:16:50.017098 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:50.017068 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-98k55_917a4780-e548-4ea4-9024-e9ed09cc4409/kube-state-metrics/0.log" May 21 18:16:50.216944 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:50.216905 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-98k55_917a4780-e548-4ea4-9024-e9ed09cc4409/kube-rbac-proxy-main/0.log" May 21 18:16:50.417615 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:50.417538 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-98k55_917a4780-e548-4ea4-9024-e9ed09cc4409/kube-rbac-proxy-self/0.log" May 21 18:16:50.640835 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:50.640804 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:16:50.684587 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:50.684491 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b878bcf8d-lpqn7"] May 21 18:16:50.818232 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:50.818200 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-ktmhl_d12c3ec0-ace1-4642-b84a-fcd98bceac54/monitoring-plugin/0.log" May 21 18:16:51.617057 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:51.617027 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llg4s_17d5962a-b8de-457a-8094-df004dcabdf0/init-textfile/0.log" May 21 18:16:51.817942 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:51.817911 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llg4s_17d5962a-b8de-457a-8094-df004dcabdf0/node-exporter/0.log" May 21 18:16:52.017167 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:52.017136 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llg4s_17d5962a-b8de-457a-8094-df004dcabdf0/kube-rbac-proxy/0.log" May 21 18:16:54.818390 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:54.818353 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-n5vtg_7d5efd72-e838-49b4-8be3-f7e688e49b66/prometheus-operator/0.log" May 21 18:16:55.017028 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:55.016994 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-n5vtg_7d5efd72-e838-49b4-8be3-f7e688e49b66/kube-rbac-proxy/0.log" May 21 18:16:55.221594 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:55.221560 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq_62496169-eb04-4977-a853-2284db734f9a/prometheus-operator-admission-webhook/0.log" May 21 18:16:56.614611 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:56.614580 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ml5nd" May 21 18:16:56.616253 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:56.616223 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-khmbf_2acffa6e-505b-4ad8-9148-e3902dd73951/networking-console-plugin/0.log" May 21 18:16:56.816609 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:56.816580 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:16:57.021051 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:57.021022 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/3.log" May 21 18:16:57.220320 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:57.220288 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7cf65588-w2xlk_055be9e0-494f-41f3-9fb0-274570789f0f/console/0.log" May 21 18:16:57.417551 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:57.417478 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b878bcf8d-lpqn7_1dbe72e3-1f99-4a49-83e2-746986579225/console/0.log" May 21 18:16:57.621224 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:16:57.621199 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-tp8pr_8fa407f3-0ab6-49e8-a914-93656a5adab6/download-server/0.log" May 21 18:17:15.709506 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:15.709445 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b878bcf8d-lpqn7" podUID="1dbe72e3-1f99-4a49-83e2-746986579225" containerName="console" containerID="cri-o://8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da" gracePeriod=15 May 21 18:17:15.988892 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:15.988869 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b878bcf8d-lpqn7_1dbe72e3-1f99-4a49-83e2-746986579225/console/0.log" May 21 18:17:15.989013 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:15.988931 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:17:16.127554 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.127523 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-serving-cert\") pod \"1dbe72e3-1f99-4a49-83e2-746986579225\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " May 21 18:17:16.127762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.127580 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-console-config\") pod \"1dbe72e3-1f99-4a49-83e2-746986579225\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " May 21 18:17:16.127762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.127619 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-service-ca\") pod \"1dbe72e3-1f99-4a49-83e2-746986579225\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " May 21 18:17:16.127762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.127650 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-oauth-serving-cert\") pod \"1dbe72e3-1f99-4a49-83e2-746986579225\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " May 21 18:17:16.127762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.127670 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-oauth-config\") pod \"1dbe72e3-1f99-4a49-83e2-746986579225\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " May 21 18:17:16.127762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.127706 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-727q9\" (UniqueName: \"kubernetes.io/projected/1dbe72e3-1f99-4a49-83e2-746986579225-kube-api-access-727q9\") pod \"1dbe72e3-1f99-4a49-83e2-746986579225\" (UID: \"1dbe72e3-1f99-4a49-83e2-746986579225\") " May 21 18:17:16.128150 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.128087 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-service-ca" (OuterVolumeSpecName: "service-ca") pod "1dbe72e3-1f99-4a49-83e2-746986579225" (UID: "1dbe72e3-1f99-4a49-83e2-746986579225"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:16.128271 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.128083 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1dbe72e3-1f99-4a49-83e2-746986579225" (UID: "1dbe72e3-1f99-4a49-83e2-746986579225"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:16.128271 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.128083 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-console-config" (OuterVolumeSpecName: "console-config") pod "1dbe72e3-1f99-4a49-83e2-746986579225" (UID: "1dbe72e3-1f99-4a49-83e2-746986579225"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:16.128443 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.128361 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-console-config\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:17:16.128443 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.128388 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-service-ca\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:17:16.128443 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.128403 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe72e3-1f99-4a49-83e2-746986579225-oauth-serving-cert\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:17:16.130013 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.129988 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1dbe72e3-1f99-4a49-83e2-746986579225" (UID: "1dbe72e3-1f99-4a49-83e2-746986579225"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:16.130013 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.130000 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1dbe72e3-1f99-4a49-83e2-746986579225" (UID: "1dbe72e3-1f99-4a49-83e2-746986579225"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:16.130162 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.129997 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dbe72e3-1f99-4a49-83e2-746986579225-kube-api-access-727q9" (OuterVolumeSpecName: "kube-api-access-727q9") pod "1dbe72e3-1f99-4a49-83e2-746986579225" (UID: "1dbe72e3-1f99-4a49-83e2-746986579225"). InnerVolumeSpecName "kube-api-access-727q9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:17:16.228938 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.228861 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-727q9\" (UniqueName: \"kubernetes.io/projected/1dbe72e3-1f99-4a49-83e2-746986579225-kube-api-access-727q9\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:17:16.228938 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.228888 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-serving-cert\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:17:16.228938 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.228897 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe72e3-1f99-4a49-83e2-746986579225-console-oauth-config\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:17:16.723716 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.723686 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b878bcf8d-lpqn7_1dbe72e3-1f99-4a49-83e2-746986579225/console/0.log" May 21 18:17:16.724169 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.723735 2555 generic.go:358] "Generic (PLEG): container finished" podID="1dbe72e3-1f99-4a49-83e2-746986579225" containerID="8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da" exitCode=2 May 21 18:17:16.724169 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.723798 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b878bcf8d-lpqn7" May 21 18:17:16.724169 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.723826 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b878bcf8d-lpqn7" event={"ID":"1dbe72e3-1f99-4a49-83e2-746986579225","Type":"ContainerDied","Data":"8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da"} May 21 18:17:16.724169 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.723878 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b878bcf8d-lpqn7" event={"ID":"1dbe72e3-1f99-4a49-83e2-746986579225","Type":"ContainerDied","Data":"788e23873ada4359c919113fccd949c20afd051109c97ebcd0f287c2e34e44e1"} May 21 18:17:16.724169 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.723899 2555 scope.go:117] "RemoveContainer" containerID="8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da" May 21 18:17:16.732812 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.732795 2555 scope.go:117] "RemoveContainer" containerID="8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da" May 21 18:17:16.733158 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:17:16.733100 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da\": container with ID starting with 8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da not found: ID does not exist" containerID="8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da" May 21 18:17:16.733256 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.733161 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da"} err="failed to get container status \"8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da\": rpc error: code = NotFound desc = could not find container \"8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da\": container with ID starting with 8a9a473d14ce25ea78c3000d24bf0a00e72fa13ef8cd50f428d179d57c6480da not found: ID does not exist" May 21 18:17:16.744665 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.744635 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b878bcf8d-lpqn7"] May 21 18:17:16.751138 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:16.751098 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b878bcf8d-lpqn7"] May 21 18:17:17.021348 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:17.021274 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dbe72e3-1f99-4a49-83e2-746986579225" path="/var/lib/kubelet/pods/1dbe72e3-1f99-4a49-83e2-746986579225/volumes" May 21 18:17:38.482421 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.482380 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5676f5b4-2hpl6"] May 21 18:17:38.482995 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.482848 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbe72e3-1f99-4a49-83e2-746986579225" containerName="console" May 21 18:17:38.482995 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.482869 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbe72e3-1f99-4a49-83e2-746986579225" containerName="console" May 21 18:17:38.482995 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.482927 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="1dbe72e3-1f99-4a49-83e2-746986579225" containerName="console" May 21 18:17:38.485099 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.485071 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.494980 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.494951 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5676f5b4-2hpl6"] May 21 18:17:38.619003 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.618962 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-oauth-config\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.619003 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.619000 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-serving-cert\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.619274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.619020 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-trusted-ca-bundle\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.619274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.619041 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-oauth-serving-cert\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.619274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.619066 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwf96\" (UniqueName: \"kubernetes.io/projected/a290fe8d-fce9-4196-9b19-9335dec78f37-kube-api-access-kwf96\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.619274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.619166 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-console-config\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.619274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.619193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-service-ca\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.720509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.720465 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-oauth-config\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.720701 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.720523 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-serving-cert\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.720701 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.720549 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-trusted-ca-bundle\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.720701 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.720575 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-oauth-serving-cert\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.720701 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.720600 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwf96\" (UniqueName: \"kubernetes.io/projected/a290fe8d-fce9-4196-9b19-9335dec78f37-kube-api-access-kwf96\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.720701 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.720674 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-console-config\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.720701 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.720698 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-service-ca\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.721496 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.721469 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-service-ca\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.722332 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.722304 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-trusted-ca-bundle\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.722448 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.722354 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-oauth-serving-cert\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.722448 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.722364 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-console-config\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.724152 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.724128 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-serving-cert\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.724578 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.724555 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-oauth-config\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.729554 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.729529 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwf96\" (UniqueName: \"kubernetes.io/projected/a290fe8d-fce9-4196-9b19-9335dec78f37-kube-api-access-kwf96\") pod \"console-b5676f5b4-2hpl6\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.796480 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.796395 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:38.940290 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:38.940246 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5676f5b4-2hpl6"] May 21 18:17:38.943912 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:17:38.943887 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda290fe8d_fce9_4196_9b19_9335dec78f37.slice/crio-362a5568e9fb92772c16e49563be6cce12474bc208c19be5073f9e2ef915245e WatchSource:0}: Error finding container 362a5568e9fb92772c16e49563be6cce12474bc208c19be5073f9e2ef915245e: Status 404 returned error can't find the container with id 362a5568e9fb92772c16e49563be6cce12474bc208c19be5073f9e2ef915245e May 21 18:17:39.794098 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:39.794059 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5676f5b4-2hpl6" event={"ID":"a290fe8d-fce9-4196-9b19-9335dec78f37","Type":"ContainerStarted","Data":"a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e"} May 21 18:17:39.794098 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:39.794102 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5676f5b4-2hpl6" event={"ID":"a290fe8d-fce9-4196-9b19-9335dec78f37","Type":"ContainerStarted","Data":"362a5568e9fb92772c16e49563be6cce12474bc208c19be5073f9e2ef915245e"} May 21 18:17:39.811157 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:39.811090 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b5676f5b4-2hpl6" podStartSLOduration=1.811077086 podStartE2EDuration="1.811077086s" podCreationTimestamp="2026-05-21 18:17:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:17:39.809658567 +0000 UTC m=+229.373749828" watchObservedRunningTime="2026-05-21 18:17:39.811077086 +0000 UTC m=+229.375168347" May 21 18:17:48.797076 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:48.797035 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:48.797076 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:48.797077 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:48.801890 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:48.801863 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:48.826613 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:48.826579 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:17:48.878227 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:17:48.878194 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7cf65588-w2xlk"] May 21 18:18:13.903230 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:13.903141 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6d7cf65588-w2xlk" podUID="055be9e0-494f-41f3-9fb0-274570789f0f" containerName="console" containerID="cri-o://4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0" gracePeriod=15 May 21 18:18:14.155905 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.155845 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7cf65588-w2xlk_055be9e0-494f-41f3-9fb0-274570789f0f/console/0.log" May 21 18:18:14.156026 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.155906 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:18:14.204271 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204236 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-oauth-config\") pod \"055be9e0-494f-41f3-9fb0-274570789f0f\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " May 21 18:18:14.204271 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204273 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-oauth-serving-cert\") pod \"055be9e0-494f-41f3-9fb0-274570789f0f\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " May 21 18:18:14.204504 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204296 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-trusted-ca-bundle\") pod \"055be9e0-494f-41f3-9fb0-274570789f0f\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " May 21 18:18:14.204504 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204329 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-console-config\") pod \"055be9e0-494f-41f3-9fb0-274570789f0f\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " May 21 18:18:14.204504 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204366 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-serving-cert\") pod \"055be9e0-494f-41f3-9fb0-274570789f0f\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " May 21 18:18:14.204504 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204432 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8h49\" (UniqueName: \"kubernetes.io/projected/055be9e0-494f-41f3-9fb0-274570789f0f-kube-api-access-z8h49\") pod \"055be9e0-494f-41f3-9fb0-274570789f0f\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " May 21 18:18:14.204504 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204461 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-service-ca\") pod \"055be9e0-494f-41f3-9fb0-274570789f0f\" (UID: \"055be9e0-494f-41f3-9fb0-274570789f0f\") " May 21 18:18:14.204769 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204742 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "055be9e0-494f-41f3-9fb0-274570789f0f" (UID: "055be9e0-494f-41f3-9fb0-274570789f0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:18:14.204874 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204778 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "055be9e0-494f-41f3-9fb0-274570789f0f" (UID: "055be9e0-494f-41f3-9fb0-274570789f0f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:18:14.205014 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204873 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-console-config" (OuterVolumeSpecName: "console-config") pod "055be9e0-494f-41f3-9fb0-274570789f0f" (UID: "055be9e0-494f-41f3-9fb0-274570789f0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:18:14.205014 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.204947 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "055be9e0-494f-41f3-9fb0-274570789f0f" (UID: "055be9e0-494f-41f3-9fb0-274570789f0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:18:14.206569 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.206538 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "055be9e0-494f-41f3-9fb0-274570789f0f" (UID: "055be9e0-494f-41f3-9fb0-274570789f0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:18:14.206670 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.206583 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055be9e0-494f-41f3-9fb0-274570789f0f-kube-api-access-z8h49" (OuterVolumeSpecName: "kube-api-access-z8h49") pod "055be9e0-494f-41f3-9fb0-274570789f0f" (UID: "055be9e0-494f-41f3-9fb0-274570789f0f"). InnerVolumeSpecName "kube-api-access-z8h49". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:18:14.206670 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.206611 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "055be9e0-494f-41f3-9fb0-274570789f0f" (UID: "055be9e0-494f-41f3-9fb0-274570789f0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:18:14.305339 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.305296 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-oauth-config\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:18:14.305339 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.305330 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-oauth-serving-cert\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:18:14.305339 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.305339 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-trusted-ca-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:18:14.305339 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.305348 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-console-config\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:18:14.305593 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.305358 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/055be9e0-494f-41f3-9fb0-274570789f0f-console-serving-cert\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:18:14.305593 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.305367 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8h49\" (UniqueName: \"kubernetes.io/projected/055be9e0-494f-41f3-9fb0-274570789f0f-kube-api-access-z8h49\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:18:14.305593 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.305377 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/055be9e0-494f-41f3-9fb0-274570789f0f-service-ca\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:18:14.903594 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.903563 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7cf65588-w2xlk_055be9e0-494f-41f3-9fb0-274570789f0f/console/0.log" May 21 18:18:14.904004 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.903603 2555 generic.go:358] "Generic (PLEG): container finished" podID="055be9e0-494f-41f3-9fb0-274570789f0f" containerID="4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0" exitCode=2 May 21 18:18:14.904004 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.903638 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7cf65588-w2xlk" event={"ID":"055be9e0-494f-41f3-9fb0-274570789f0f","Type":"ContainerDied","Data":"4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0"} May 21 18:18:14.904004 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.903669 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7cf65588-w2xlk" May 21 18:18:14.904004 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.903679 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7cf65588-w2xlk" event={"ID":"055be9e0-494f-41f3-9fb0-274570789f0f","Type":"ContainerDied","Data":"cf209e009de4ad3bb12ff4608b97d36c77462c1cb6efad1f5272c9e6de74c9df"} May 21 18:18:14.904004 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.903696 2555 scope.go:117] "RemoveContainer" containerID="4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0" May 21 18:18:14.912298 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.912279 2555 scope.go:117] "RemoveContainer" containerID="4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0" May 21 18:18:14.912548 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:18:14.912529 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0\": container with ID starting with 4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0 not found: ID does not exist" containerID="4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0" May 21 18:18:14.912586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.912559 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0"} err="failed to get container status \"4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0\": rpc error: code = NotFound desc = could not find container \"4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0\": container with ID starting with 4e606de2c2eb656c0bbde55b96d16140add66ecdb67a3d20483d761671cb93c0 not found: ID does not exist" May 21 18:18:14.924632 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.924601 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7cf65588-w2xlk"] May 21 18:18:14.927723 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:14.927696 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d7cf65588-w2xlk"] May 21 18:18:15.020329 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:15.020286 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="055be9e0-494f-41f3-9fb0-274570789f0f" path="/var/lib/kubelet/pods/055be9e0-494f-41f3-9fb0-274570789f0f/volumes" May 21 18:18:50.889926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:50.889898 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:18:50.890471 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:50.890149 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:18:50.898616 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:18:50.898596 2555 kubelet.go:1628] "Image garbage collection succeeded" May 21 18:19:25.892989 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.892945 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-95b75d849-djfsl"] May 21 18:19:25.894586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.893305 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055be9e0-494f-41f3-9fb0-274570789f0f" containerName="console" May 21 18:19:25.894586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.893320 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="055be9e0-494f-41f3-9fb0-274570789f0f" containerName="console" May 21 18:19:25.894586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.893371 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="055be9e0-494f-41f3-9fb0-274570789f0f" containerName="console" May 21 18:19:25.895178 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.895161 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:25.907375 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.907349 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95b75d849-djfsl"] May 21 18:19:25.988163 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.988103 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-trusted-ca-bundle\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:25.988163 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.988167 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-serving-cert\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:25.988391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.988201 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-oauth-config\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:25.988391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.988225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6p29\" (UniqueName: \"kubernetes.io/projected/c8c5164c-a0e2-4506-bc66-7facd29b55d9-kube-api-access-r6p29\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:25.988391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.988342 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-oauth-serving-cert\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:25.988391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.988378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-config\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:25.988532 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:25.988405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-service-ca\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.089176 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.089134 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-oauth-serving-cert\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.089176 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.089183 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-config\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.089426 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.089210 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-service-ca\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.089426 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.089241 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-trusted-ca-bundle\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.089426 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.089257 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-serving-cert\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.089426 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.089283 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-oauth-config\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.089426 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.089306 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6p29\" (UniqueName: \"kubernetes.io/projected/c8c5164c-a0e2-4506-bc66-7facd29b55d9-kube-api-access-r6p29\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.089966 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.089934 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-config\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.090098 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.090039 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-oauth-serving-cert\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.090098 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.090073 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-service-ca\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.090274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.090250 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-trusted-ca-bundle\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.091942 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.091916 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-oauth-config\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.092010 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.091994 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-serving-cert\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.098932 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.098906 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6p29\" (UniqueName: \"kubernetes.io/projected/c8c5164c-a0e2-4506-bc66-7facd29b55d9-kube-api-access-r6p29\") pod \"console-95b75d849-djfsl\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.205374 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.205283 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:26.340174 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.340146 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95b75d849-djfsl"] May 21 18:19:26.342883 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:19:26.342850 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c5164c_a0e2_4506_bc66_7facd29b55d9.slice/crio-3a08e8ffbf4fb6e72b1118d2ec255b9b3e5f5fcccf59c38dfba7d8f9b3b41621 WatchSource:0}: Error finding container 3a08e8ffbf4fb6e72b1118d2ec255b9b3e5f5fcccf59c38dfba7d8f9b3b41621: Status 404 returned error can't find the container with id 3a08e8ffbf4fb6e72b1118d2ec255b9b3e5f5fcccf59c38dfba7d8f9b3b41621 May 21 18:19:26.344729 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:26.344712 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:19:27.111425 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:27.111388 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95b75d849-djfsl" event={"ID":"c8c5164c-a0e2-4506-bc66-7facd29b55d9","Type":"ContainerStarted","Data":"cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e"} May 21 18:19:27.111425 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:27.111428 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95b75d849-djfsl" event={"ID":"c8c5164c-a0e2-4506-bc66-7facd29b55d9","Type":"ContainerStarted","Data":"3a08e8ffbf4fb6e72b1118d2ec255b9b3e5f5fcccf59c38dfba7d8f9b3b41621"} May 21 18:19:27.128609 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:27.128562 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-95b75d849-djfsl" podStartSLOduration=2.128546172 podStartE2EDuration="2.128546172s" podCreationTimestamp="2026-05-21 18:19:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:19:27.127403595 +0000 UTC m=+336.691494858" watchObservedRunningTime="2026-05-21 18:19:27.128546172 +0000 UTC m=+336.692637433" May 21 18:19:31.439422 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.439382 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zwkm2"] May 21 18:19:31.441794 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.441768 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.444522 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.444489 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 18:19:31.452234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.452212 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zwkm2"] May 21 18:19:31.534700 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.534661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-kubelet-config\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.534877 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.534717 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-original-pull-secret\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.534877 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.534818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-dbus\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.635672 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.635632 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-original-pull-secret\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.635859 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.635698 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-dbus\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.635859 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.635733 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-kubelet-config\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.635859 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.635819 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-kubelet-config\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.635974 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.635891 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-dbus\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.637960 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.637936 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff-original-pull-secret\") pod \"global-pull-secret-syncer-zwkm2\" (UID: \"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff\") " pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.752302 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.752263 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zwkm2" May 21 18:19:31.882303 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:31.882264 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zwkm2"] May 21 18:19:31.885349 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:19:31.885324 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7c4ab5_35d9_440d_a0d5_e8b2e10cdbff.slice/crio-b5f4e30fecca37ac47c535da83c06cb0e75bb88beacdb13136155f56ce0a0bfd WatchSource:0}: Error finding container b5f4e30fecca37ac47c535da83c06cb0e75bb88beacdb13136155f56ce0a0bfd: Status 404 returned error can't find the container with id b5f4e30fecca37ac47c535da83c06cb0e75bb88beacdb13136155f56ce0a0bfd May 21 18:19:32.126470 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:32.126372 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zwkm2" event={"ID":"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff","Type":"ContainerStarted","Data":"b5f4e30fecca37ac47c535da83c06cb0e75bb88beacdb13136155f56ce0a0bfd"} May 21 18:19:36.141012 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:36.140965 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zwkm2" event={"ID":"ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff","Type":"ContainerStarted","Data":"e89d01df2300b366094ce73c78ed3f12785b0729981962f0dc0d605dcd60a28f"} May 21 18:19:36.155838 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:36.155776 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zwkm2" podStartSLOduration=1.020529937 podStartE2EDuration="5.155756755s" podCreationTimestamp="2026-05-21 18:19:31 +0000 UTC" firstStartedPulling="2026-05-21 18:19:31.887051384 +0000 UTC m=+341.451142626" lastFinishedPulling="2026-05-21 18:19:36.022278202 +0000 UTC m=+345.586369444" observedRunningTime="2026-05-21 18:19:36.154624228 +0000 UTC m=+345.718715488" watchObservedRunningTime="2026-05-21 18:19:36.155756755 +0000 UTC m=+345.719848017" May 21 18:19:36.205917 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:36.205807 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:36.205917 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:36.205875 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:36.211001 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:36.210970 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:37.147533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:37.147498 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-95b75d849-djfsl" May 21 18:19:37.195001 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:37.194966 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5676f5b4-2hpl6"] May 21 18:19:44.919531 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:44.919490 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86"] May 21 18:19:44.922145 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:44.922095 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:44.924586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:44.924560 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 18:19:44.925299 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:44.925281 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 18:19:44.925380 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:44.925283 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cjd\"" May 21 18:19:44.932808 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:44.932782 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86"] May 21 18:19:45.058347 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.058309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8nq\" (UniqueName: \"kubernetes.io/projected/a6c526cd-7a60-49c5-8999-894eb199c109-kube-api-access-gm8nq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.058514 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.058354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.058514 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.058400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.158930 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.158887 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8nq\" (UniqueName: \"kubernetes.io/projected/a6c526cd-7a60-49c5-8999-894eb199c109-kube-api-access-gm8nq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.158930 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.158932 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.159257 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.158962 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.159341 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.159321 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.159426 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.159406 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.167778 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.167749 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8nq\" (UniqueName: \"kubernetes.io/projected/a6c526cd-7a60-49c5-8999-894eb199c109-kube-api-access-gm8nq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.232438 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.232396 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:19:45.362724 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:45.362698 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86"] May 21 18:19:45.365166 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:19:45.365131 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c526cd_7a60_49c5_8999_894eb199c109.slice/crio-dcd86f2124bf8e89b60148c19a9cb2584fa97d0bd2e41aacce9a4422043ef8c7 WatchSource:0}: Error finding container dcd86f2124bf8e89b60148c19a9cb2584fa97d0bd2e41aacce9a4422043ef8c7: Status 404 returned error can't find the container with id dcd86f2124bf8e89b60148c19a9cb2584fa97d0bd2e41aacce9a4422043ef8c7 May 21 18:19:46.170536 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:46.170493 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" event={"ID":"a6c526cd-7a60-49c5-8999-894eb199c109","Type":"ContainerStarted","Data":"dcd86f2124bf8e89b60148c19a9cb2584fa97d0bd2e41aacce9a4422043ef8c7"} May 21 18:19:52.192514 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:52.192478 2555 generic.go:358] "Generic (PLEG): container finished" podID="a6c526cd-7a60-49c5-8999-894eb199c109" containerID="de6ba2438ad00180249dcdb5992fd7b1393db932def3236e7a6e081607e56acc" exitCode=0 May 21 18:19:52.192915 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:52.192533 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" event={"ID":"a6c526cd-7a60-49c5-8999-894eb199c109","Type":"ContainerDied","Data":"de6ba2438ad00180249dcdb5992fd7b1393db932def3236e7a6e081607e56acc"} May 21 18:19:55.206092 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:55.206057 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" event={"ID":"a6c526cd-7a60-49c5-8999-894eb199c109","Type":"ContainerStarted","Data":"563b2b5c1987e1c1c6ee4b88ac308e01ce8aacf556c0f81921a4e5d35f3913ef"} May 21 18:19:56.210816 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:56.210784 2555 generic.go:358] "Generic (PLEG): container finished" podID="a6c526cd-7a60-49c5-8999-894eb199c109" containerID="563b2b5c1987e1c1c6ee4b88ac308e01ce8aacf556c0f81921a4e5d35f3913ef" exitCode=0 May 21 18:19:56.211225 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:19:56.210867 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" event={"ID":"a6c526cd-7a60-49c5-8999-894eb199c109","Type":"ContainerDied","Data":"563b2b5c1987e1c1c6ee4b88ac308e01ce8aacf556c0f81921a4e5d35f3913ef"} May 21 18:20:02.218489 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:02.218405 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b5676f5b4-2hpl6" podUID="a290fe8d-fce9-4196-9b19-9335dec78f37" containerName="console" containerID="cri-o://a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e" gracePeriod=15 May 21 18:20:03.884666 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.884642 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b5676f5b4-2hpl6_a290fe8d-fce9-4196-9b19-9335dec78f37/console/0.log" May 21 18:20:03.885058 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.884718 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:20:03.912457 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.912422 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-service-ca\") pod \"a290fe8d-fce9-4196-9b19-9335dec78f37\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " May 21 18:20:03.912643 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.912483 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-serving-cert\") pod \"a290fe8d-fce9-4196-9b19-9335dec78f37\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " May 21 18:20:03.912643 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.912581 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-console-config\") pod \"a290fe8d-fce9-4196-9b19-9335dec78f37\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " May 21 18:20:03.912643 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.912617 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwf96\" (UniqueName: \"kubernetes.io/projected/a290fe8d-fce9-4196-9b19-9335dec78f37-kube-api-access-kwf96\") pod \"a290fe8d-fce9-4196-9b19-9335dec78f37\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " May 21 18:20:03.912901 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.912667 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-trusted-ca-bundle\") pod \"a290fe8d-fce9-4196-9b19-9335dec78f37\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " May 21 18:20:03.912901 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.912712 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-oauth-serving-cert\") pod \"a290fe8d-fce9-4196-9b19-9335dec78f37\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " May 21 18:20:03.912901 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.912750 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-oauth-config\") pod \"a290fe8d-fce9-4196-9b19-9335dec78f37\" (UID: \"a290fe8d-fce9-4196-9b19-9335dec78f37\") " May 21 18:20:03.913053 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.912890 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-service-ca" (OuterVolumeSpecName: "service-ca") pod "a290fe8d-fce9-4196-9b19-9335dec78f37" (UID: "a290fe8d-fce9-4196-9b19-9335dec78f37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:20:03.913212 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.913078 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-service-ca\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:03.914467 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.913374 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a290fe8d-fce9-4196-9b19-9335dec78f37" (UID: "a290fe8d-fce9-4196-9b19-9335dec78f37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:20:03.914467 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.913568 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-console-config" (OuterVolumeSpecName: "console-config") pod "a290fe8d-fce9-4196-9b19-9335dec78f37" (UID: "a290fe8d-fce9-4196-9b19-9335dec78f37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:20:03.914467 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.914132 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a290fe8d-fce9-4196-9b19-9335dec78f37" (UID: "a290fe8d-fce9-4196-9b19-9335dec78f37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:20:03.915407 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.915379 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a290fe8d-fce9-4196-9b19-9335dec78f37" (UID: "a290fe8d-fce9-4196-9b19-9335dec78f37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:20:03.915740 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.915708 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a290fe8d-fce9-4196-9b19-9335dec78f37-kube-api-access-kwf96" (OuterVolumeSpecName: "kube-api-access-kwf96") pod "a290fe8d-fce9-4196-9b19-9335dec78f37" (UID: "a290fe8d-fce9-4196-9b19-9335dec78f37"). InnerVolumeSpecName "kube-api-access-kwf96". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:20:03.915740 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:03.915715 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a290fe8d-fce9-4196-9b19-9335dec78f37" (UID: "a290fe8d-fce9-4196-9b19-9335dec78f37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:20:04.013600 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.013564 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-console-config\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:04.013600 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.013593 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwf96\" (UniqueName: \"kubernetes.io/projected/a290fe8d-fce9-4196-9b19-9335dec78f37-kube-api-access-kwf96\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:04.013600 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.013605 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-trusted-ca-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:04.013802 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.013614 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a290fe8d-fce9-4196-9b19-9335dec78f37-oauth-serving-cert\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:04.013802 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.013623 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-oauth-config\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:04.013802 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.013632 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a290fe8d-fce9-4196-9b19-9335dec78f37-console-serving-cert\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:04.236614 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.236583 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b5676f5b4-2hpl6_a290fe8d-fce9-4196-9b19-9335dec78f37/console/0.log" May 21 18:20:04.236774 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.236626 2555 generic.go:358] "Generic (PLEG): container finished" podID="a290fe8d-fce9-4196-9b19-9335dec78f37" containerID="a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e" exitCode=2 May 21 18:20:04.236774 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.236704 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5676f5b4-2hpl6" May 21 18:20:04.236774 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.236722 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5676f5b4-2hpl6" event={"ID":"a290fe8d-fce9-4196-9b19-9335dec78f37","Type":"ContainerDied","Data":"a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e"} May 21 18:20:04.236971 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.236775 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5676f5b4-2hpl6" event={"ID":"a290fe8d-fce9-4196-9b19-9335dec78f37","Type":"ContainerDied","Data":"362a5568e9fb92772c16e49563be6cce12474bc208c19be5073f9e2ef915245e"} May 21 18:20:04.236971 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.236795 2555 scope.go:117] "RemoveContainer" containerID="a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e" May 21 18:20:04.238795 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.238772 2555 generic.go:358] "Generic (PLEG): container finished" podID="a6c526cd-7a60-49c5-8999-894eb199c109" containerID="d4d1e4bc558cad22cc50f7243ec3d3addea649d7b2899818f30ef2b138d922f7" exitCode=0 May 21 18:20:04.238886 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.238810 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" event={"ID":"a6c526cd-7a60-49c5-8999-894eb199c109","Type":"ContainerDied","Data":"d4d1e4bc558cad22cc50f7243ec3d3addea649d7b2899818f30ef2b138d922f7"} May 21 18:20:04.245234 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.245215 2555 scope.go:117] "RemoveContainer" containerID="a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e" May 21 18:20:04.245481 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:20:04.245464 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e\": container with ID starting with a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e not found: ID does not exist" containerID="a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e" May 21 18:20:04.245536 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.245489 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e"} err="failed to get container status \"a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e\": rpc error: code = NotFound desc = could not find container \"a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e\": container with ID starting with a957f2086e85faf7acda352df8d65adc63b8158f7e594635fde82ba57df6ea3e not found: ID does not exist" May 21 18:20:04.277933 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.277764 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5676f5b4-2hpl6"] May 21 18:20:04.281238 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:04.281199 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b5676f5b4-2hpl6"] May 21 18:20:05.021392 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.021298 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a290fe8d-fce9-4196-9b19-9335dec78f37" path="/var/lib/kubelet/pods/a290fe8d-fce9-4196-9b19-9335dec78f37/volumes" May 21 18:20:05.367980 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.367954 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:20:05.422486 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.422438 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-bundle\") pod \"a6c526cd-7a60-49c5-8999-894eb199c109\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " May 21 18:20:05.422702 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.422536 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-util\") pod \"a6c526cd-7a60-49c5-8999-894eb199c109\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " May 21 18:20:05.422702 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.422568 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm8nq\" (UniqueName: \"kubernetes.io/projected/a6c526cd-7a60-49c5-8999-894eb199c109-kube-api-access-gm8nq\") pod \"a6c526cd-7a60-49c5-8999-894eb199c109\" (UID: \"a6c526cd-7a60-49c5-8999-894eb199c109\") " May 21 18:20:05.423243 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.423214 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-bundle" (OuterVolumeSpecName: "bundle") pod "a6c526cd-7a60-49c5-8999-894eb199c109" (UID: "a6c526cd-7a60-49c5-8999-894eb199c109"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:20:05.424920 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.424886 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c526cd-7a60-49c5-8999-894eb199c109-kube-api-access-gm8nq" (OuterVolumeSpecName: "kube-api-access-gm8nq") pod "a6c526cd-7a60-49c5-8999-894eb199c109" (UID: "a6c526cd-7a60-49c5-8999-894eb199c109"). InnerVolumeSpecName "kube-api-access-gm8nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:20:05.427297 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.427264 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-util" (OuterVolumeSpecName: "util") pod "a6c526cd-7a60-49c5-8999-894eb199c109" (UID: "a6c526cd-7a60-49c5-8999-894eb199c109"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:20:05.523781 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.523742 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:05.523781 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.523776 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm8nq\" (UniqueName: \"kubernetes.io/projected/a6c526cd-7a60-49c5-8999-894eb199c109-kube-api-access-gm8nq\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:05.523781 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:05.523790 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6c526cd-7a60-49c5-8999-894eb199c109-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:06.246894 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:06.246858 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" event={"ID":"a6c526cd-7a60-49c5-8999-894eb199c109","Type":"ContainerDied","Data":"dcd86f2124bf8e89b60148c19a9cb2584fa97d0bd2e41aacce9a4422043ef8c7"} May 21 18:20:06.246894 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:06.246895 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcd86f2124bf8e89b60148c19a9cb2584fa97d0bd2e41aacce9a4422043ef8c7" May 21 18:20:06.247361 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:06.246899 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6q86" May 21 18:20:13.206085 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206048 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4"] May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206359 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c526cd-7a60-49c5-8999-894eb199c109" containerName="pull" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206373 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c526cd-7a60-49c5-8999-894eb199c109" containerName="pull" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206384 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c526cd-7a60-49c5-8999-894eb199c109" containerName="util" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206389 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c526cd-7a60-49c5-8999-894eb199c109" containerName="util" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206397 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a290fe8d-fce9-4196-9b19-9335dec78f37" containerName="console" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206403 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a290fe8d-fce9-4196-9b19-9335dec78f37" containerName="console" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206423 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c526cd-7a60-49c5-8999-894eb199c109" containerName="extract" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206428 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c526cd-7a60-49c5-8999-894eb199c109" containerName="extract" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206470 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a290fe8d-fce9-4196-9b19-9335dec78f37" containerName="console" May 21 18:20:13.206476 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.206478 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c526cd-7a60-49c5-8999-894eb199c109" containerName="extract" May 21 18:20:13.208481 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.208465 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" May 21 18:20:13.211416 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.211393 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7psmt\"" May 21 18:20:13.211531 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.211428 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 18:20:13.211531 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.211454 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 18:20:13.222958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.222935 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4"] May 21 18:20:13.288752 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.288713 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d489c7f-bc7c-494e-b3e2-d1b4b9b86119-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-kp5j4\" (UID: \"9d489c7f-bc7c-494e-b3e2-d1b4b9b86119\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" May 21 18:20:13.288914 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.288766 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x9gr\" (UniqueName: \"kubernetes.io/projected/9d489c7f-bc7c-494e-b3e2-d1b4b9b86119-kube-api-access-6x9gr\") pod \"cert-manager-operator-controller-manager-54b9655956-kp5j4\" (UID: \"9d489c7f-bc7c-494e-b3e2-d1b4b9b86119\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" May 21 18:20:13.389394 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.389352 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d489c7f-bc7c-494e-b3e2-d1b4b9b86119-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-kp5j4\" (UID: \"9d489c7f-bc7c-494e-b3e2-d1b4b9b86119\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" May 21 18:20:13.389574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.389420 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x9gr\" (UniqueName: \"kubernetes.io/projected/9d489c7f-bc7c-494e-b3e2-d1b4b9b86119-kube-api-access-6x9gr\") pod \"cert-manager-operator-controller-manager-54b9655956-kp5j4\" (UID: \"9d489c7f-bc7c-494e-b3e2-d1b4b9b86119\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" May 21 18:20:13.389771 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.389751 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d489c7f-bc7c-494e-b3e2-d1b4b9b86119-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-kp5j4\" (UID: \"9d489c7f-bc7c-494e-b3e2-d1b4b9b86119\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" May 21 18:20:13.397919 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.397895 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x9gr\" (UniqueName: \"kubernetes.io/projected/9d489c7f-bc7c-494e-b3e2-d1b4b9b86119-kube-api-access-6x9gr\") pod \"cert-manager-operator-controller-manager-54b9655956-kp5j4\" (UID: \"9d489c7f-bc7c-494e-b3e2-d1b4b9b86119\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" May 21 18:20:13.517082 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.517050 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" May 21 18:20:13.654512 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:13.654480 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4"] May 21 18:20:13.656731 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:20:13.656701 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d489c7f_bc7c_494e_b3e2_d1b4b9b86119.slice/crio-90227286a8d077c2d1e6d8cd7ab36fb3b2671f6f96beba59c4bb053333a97338 WatchSource:0}: Error finding container 90227286a8d077c2d1e6d8cd7ab36fb3b2671f6f96beba59c4bb053333a97338: Status 404 returned error can't find the container with id 90227286a8d077c2d1e6d8cd7ab36fb3b2671f6f96beba59c4bb053333a97338 May 21 18:20:14.271953 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:14.271909 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" event={"ID":"9d489c7f-bc7c-494e-b3e2-d1b4b9b86119","Type":"ContainerStarted","Data":"90227286a8d077c2d1e6d8cd7ab36fb3b2671f6f96beba59c4bb053333a97338"} May 21 18:20:15.276615 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:15.276572 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" event={"ID":"9d489c7f-bc7c-494e-b3e2-d1b4b9b86119","Type":"ContainerStarted","Data":"fd3b19bc2f8cd330caaaf0e8c184c476a967d479918b595ff86c50695ebd93b8"} May 21 18:20:15.334770 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:15.334707 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-kp5j4" podStartSLOduration=0.843037373 podStartE2EDuration="2.33468954s" podCreationTimestamp="2026-05-21 18:20:13 +0000 UTC" firstStartedPulling="2026-05-21 18:20:13.659927803 +0000 UTC m=+383.224019046" lastFinishedPulling="2026-05-21 18:20:15.151579975 +0000 UTC m=+384.715671213" observedRunningTime="2026-05-21 18:20:15.333918215 +0000 UTC m=+384.898009478" watchObservedRunningTime="2026-05-21 18:20:15.33468954 +0000 UTC m=+384.898780806" May 21 18:20:16.785616 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.785578 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j"] May 21 18:20:16.792635 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.792599 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.795527 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.795502 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 18:20:16.795650 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.795502 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cjd\"" May 21 18:20:16.796015 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.796001 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 18:20:16.800217 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.800011 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j"] May 21 18:20:16.817613 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.817580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhlm9\" (UniqueName: \"kubernetes.io/projected/32315792-34a9-4ca3-88cb-f7a61314726f-kube-api-access-jhlm9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.817766 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.817620 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.817766 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.817702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.918926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.918887 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhlm9\" (UniqueName: \"kubernetes.io/projected/32315792-34a9-4ca3-88cb-f7a61314726f-kube-api-access-jhlm9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.918926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.918930 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.919130 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.918965 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.919430 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.919408 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.919484 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.919421 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:16.930971 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:16.930940 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhlm9\" (UniqueName: \"kubernetes.io/projected/32315792-34a9-4ca3-88cb-f7a61314726f-kube-api-access-jhlm9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:17.102749 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:17.102650 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:17.238955 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:17.238930 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j"] May 21 18:20:17.241252 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:20:17.241221 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32315792_34a9_4ca3_88cb_f7a61314726f.slice/crio-53f76318469dfebee91d592e74cde5d0aebc11b00e44346f73a3b3d553a79126 WatchSource:0}: Error finding container 53f76318469dfebee91d592e74cde5d0aebc11b00e44346f73a3b3d553a79126: Status 404 returned error can't find the container with id 53f76318469dfebee91d592e74cde5d0aebc11b00e44346f73a3b3d553a79126 May 21 18:20:17.285075 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:17.285033 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" event={"ID":"32315792-34a9-4ca3-88cb-f7a61314726f","Type":"ContainerStarted","Data":"53f76318469dfebee91d592e74cde5d0aebc11b00e44346f73a3b3d553a79126"} May 21 18:20:18.289737 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.289697 2555 generic.go:358] "Generic (PLEG): container finished" podID="32315792-34a9-4ca3-88cb-f7a61314726f" containerID="c246d36d1a1596b0c41d7b0d833816c9ad84f21043c182a31ee1716f6248d380" exitCode=0 May 21 18:20:18.290237 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.289787 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" event={"ID":"32315792-34a9-4ca3-88cb-f7a61314726f","Type":"ContainerDied","Data":"c246d36d1a1596b0c41d7b0d833816c9ad84f21043c182a31ee1716f6248d380"} May 21 18:20:18.504178 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.504136 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-pkzfh"] May 21 18:20:18.507302 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.507286 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:18.510315 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.510289 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 18:20:18.510427 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.510335 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 18:20:18.510539 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.510519 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-q48bj\"" May 21 18:20:18.518322 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.518300 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-pkzfh"] May 21 18:20:18.531082 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.531054 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-pkzfh\" (UID: \"0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:18.531260 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.531145 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkhx9\" (UniqueName: \"kubernetes.io/projected/0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89-kube-api-access-xkhx9\") pod \"cert-manager-webhook-587ccfb98-pkzfh\" (UID: \"0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:18.632223 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.632132 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkhx9\" (UniqueName: \"kubernetes.io/projected/0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89-kube-api-access-xkhx9\") pod \"cert-manager-webhook-587ccfb98-pkzfh\" (UID: \"0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:18.632223 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.632212 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-pkzfh\" (UID: \"0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:18.640920 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.640894 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-pkzfh\" (UID: \"0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:18.641055 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.641034 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkhx9\" (UniqueName: \"kubernetes.io/projected/0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89-kube-api-access-xkhx9\") pod \"cert-manager-webhook-587ccfb98-pkzfh\" (UID: \"0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:18.831641 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.831605 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:18.972840 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:20:18.972798 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d40ab2e_d14d_4ecf_8839_6f5ee92e6b89.slice/crio-6c230366523133484c5118c0906ebc52f3c334d7bfe34bae9b963bee0a1ddf66 WatchSource:0}: Error finding container 6c230366523133484c5118c0906ebc52f3c334d7bfe34bae9b963bee0a1ddf66: Status 404 returned error can't find the container with id 6c230366523133484c5118c0906ebc52f3c334d7bfe34bae9b963bee0a1ddf66 May 21 18:20:18.972840 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:18.972818 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-pkzfh"] May 21 18:20:19.295036 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:19.294996 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" event={"ID":"0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89","Type":"ContainerStarted","Data":"6c230366523133484c5118c0906ebc52f3c334d7bfe34bae9b963bee0a1ddf66"} May 21 18:20:20.305636 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:20.305596 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" event={"ID":"32315792-34a9-4ca3-88cb-f7a61314726f","Type":"ContainerStarted","Data":"05410951810ea2c69bb55192ff33831c6d020d14650d04681cd7f4167fc78c09"} May 21 18:20:21.310978 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:21.310945 2555 generic.go:358] "Generic (PLEG): container finished" podID="32315792-34a9-4ca3-88cb-f7a61314726f" containerID="05410951810ea2c69bb55192ff33831c6d020d14650d04681cd7f4167fc78c09" exitCode=0 May 21 18:20:21.311433 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:21.311031 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" event={"ID":"32315792-34a9-4ca3-88cb-f7a61314726f","Type":"ContainerDied","Data":"05410951810ea2c69bb55192ff33831c6d020d14650d04681cd7f4167fc78c09"} May 21 18:20:22.315907 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:22.315875 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" event={"ID":"0d40ab2e-d14d-4ecf-8839-6f5ee92e6b89","Type":"ContainerStarted","Data":"db43b7919483d7bce69215d02dbf315fccd8374516d17224d8ff3be0be467229"} May 21 18:20:22.316353 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:22.315947 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:22.317785 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:22.317763 2555 generic.go:358] "Generic (PLEG): container finished" podID="32315792-34a9-4ca3-88cb-f7a61314726f" containerID="99c77cff41f064acffd20a6b2762750977a7069b23a165ee61f936e43527fb74" exitCode=0 May 21 18:20:22.317883 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:22.317818 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" event={"ID":"32315792-34a9-4ca3-88cb-f7a61314726f","Type":"ContainerDied","Data":"99c77cff41f064acffd20a6b2762750977a7069b23a165ee61f936e43527fb74"} May 21 18:20:22.342477 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:22.342246 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" podStartSLOduration=1.16103454 podStartE2EDuration="4.342230216s" podCreationTimestamp="2026-05-21 18:20:18 +0000 UTC" firstStartedPulling="2026-05-21 18:20:18.975219658 +0000 UTC m=+388.539310898" lastFinishedPulling="2026-05-21 18:20:22.156415333 +0000 UTC m=+391.720506574" observedRunningTime="2026-05-21 18:20:22.341824627 +0000 UTC m=+391.905915889" watchObservedRunningTime="2026-05-21 18:20:22.342230216 +0000 UTC m=+391.906321478" May 21 18:20:23.451737 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.451710 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:23.574687 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.574590 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-util\") pod \"32315792-34a9-4ca3-88cb-f7a61314726f\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " May 21 18:20:23.574832 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.574701 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-bundle\") pod \"32315792-34a9-4ca3-88cb-f7a61314726f\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " May 21 18:20:23.574832 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.574723 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhlm9\" (UniqueName: \"kubernetes.io/projected/32315792-34a9-4ca3-88cb-f7a61314726f-kube-api-access-jhlm9\") pod \"32315792-34a9-4ca3-88cb-f7a61314726f\" (UID: \"32315792-34a9-4ca3-88cb-f7a61314726f\") " May 21 18:20:23.575062 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.575037 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-bundle" (OuterVolumeSpecName: "bundle") pod "32315792-34a9-4ca3-88cb-f7a61314726f" (UID: "32315792-34a9-4ca3-88cb-f7a61314726f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:20:23.576971 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.576942 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32315792-34a9-4ca3-88cb-f7a61314726f-kube-api-access-jhlm9" (OuterVolumeSpecName: "kube-api-access-jhlm9") pod "32315792-34a9-4ca3-88cb-f7a61314726f" (UID: "32315792-34a9-4ca3-88cb-f7a61314726f"). InnerVolumeSpecName "kube-api-access-jhlm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:20:23.579761 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.579737 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-util" (OuterVolumeSpecName: "util") pod "32315792-34a9-4ca3-88cb-f7a61314726f" (UID: "32315792-34a9-4ca3-88cb-f7a61314726f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:20:23.675780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.675740 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:23.675780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.675774 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhlm9\" (UniqueName: \"kubernetes.io/projected/32315792-34a9-4ca3-88cb-f7a61314726f-kube-api-access-jhlm9\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:23.675780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:23.675784 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32315792-34a9-4ca3-88cb-f7a61314726f-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:24.326284 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:24.326252 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" event={"ID":"32315792-34a9-4ca3-88cb-f7a61314726f","Type":"ContainerDied","Data":"53f76318469dfebee91d592e74cde5d0aebc11b00e44346f73a3b3d553a79126"} May 21 18:20:24.326284 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:24.326288 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53f76318469dfebee91d592e74cde5d0aebc11b00e44346f73a3b3d553a79126" May 21 18:20:24.326544 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:24.326293 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv246j" May 21 18:20:28.323457 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.323423 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-pkzfh" May 21 18:20:28.467321 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.467276 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wl6zc"] May 21 18:20:28.467593 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.467578 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32315792-34a9-4ca3-88cb-f7a61314726f" containerName="util" May 21 18:20:28.467593 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.467594 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="32315792-34a9-4ca3-88cb-f7a61314726f" containerName="util" May 21 18:20:28.467734 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.467605 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32315792-34a9-4ca3-88cb-f7a61314726f" containerName="extract" May 21 18:20:28.467734 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.467611 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="32315792-34a9-4ca3-88cb-f7a61314726f" containerName="extract" May 21 18:20:28.467734 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.467629 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32315792-34a9-4ca3-88cb-f7a61314726f" containerName="pull" May 21 18:20:28.467734 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.467635 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="32315792-34a9-4ca3-88cb-f7a61314726f" containerName="pull" May 21 18:20:28.467734 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.467706 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="32315792-34a9-4ca3-88cb-f7a61314726f" containerName="extract" May 21 18:20:28.471016 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.470999 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-wl6zc" May 21 18:20:28.473459 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.473436 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-f5pgk\"" May 21 18:20:28.485732 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.485707 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wl6zc"] May 21 18:20:28.519800 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.519760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kb5w\" (UniqueName: \"kubernetes.io/projected/8d7d805d-c4b5-41e6-b395-e9e733b264d3-kube-api-access-7kb5w\") pod \"cert-manager-79c8d999ff-wl6zc\" (UID: \"8d7d805d-c4b5-41e6-b395-e9e733b264d3\") " pod="cert-manager/cert-manager-79c8d999ff-wl6zc" May 21 18:20:28.519966 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.519811 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d7d805d-c4b5-41e6-b395-e9e733b264d3-bound-sa-token\") pod \"cert-manager-79c8d999ff-wl6zc\" (UID: \"8d7d805d-c4b5-41e6-b395-e9e733b264d3\") " pod="cert-manager/cert-manager-79c8d999ff-wl6zc" May 21 18:20:28.620518 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.620429 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kb5w\" (UniqueName: \"kubernetes.io/projected/8d7d805d-c4b5-41e6-b395-e9e733b264d3-kube-api-access-7kb5w\") pod \"cert-manager-79c8d999ff-wl6zc\" (UID: \"8d7d805d-c4b5-41e6-b395-e9e733b264d3\") " pod="cert-manager/cert-manager-79c8d999ff-wl6zc" May 21 18:20:28.620518 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.620469 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d7d805d-c4b5-41e6-b395-e9e733b264d3-bound-sa-token\") pod \"cert-manager-79c8d999ff-wl6zc\" (UID: \"8d7d805d-c4b5-41e6-b395-e9e733b264d3\") " pod="cert-manager/cert-manager-79c8d999ff-wl6zc" May 21 18:20:28.628992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.628954 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d7d805d-c4b5-41e6-b395-e9e733b264d3-bound-sa-token\") pod \"cert-manager-79c8d999ff-wl6zc\" (UID: \"8d7d805d-c4b5-41e6-b395-e9e733b264d3\") " pod="cert-manager/cert-manager-79c8d999ff-wl6zc" May 21 18:20:28.628992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.628982 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kb5w\" (UniqueName: \"kubernetes.io/projected/8d7d805d-c4b5-41e6-b395-e9e733b264d3-kube-api-access-7kb5w\") pod \"cert-manager-79c8d999ff-wl6zc\" (UID: \"8d7d805d-c4b5-41e6-b395-e9e733b264d3\") " pod="cert-manager/cert-manager-79c8d999ff-wl6zc" May 21 18:20:28.780209 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.780167 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-wl6zc" May 21 18:20:28.908559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:28.908531 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wl6zc"] May 21 18:20:28.910550 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:20:28.910521 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d7d805d_c4b5_41e6_b395_e9e733b264d3.slice/crio-c90abba5781ec90f05ba7a43a43ba2e153fc65e8b9cd125b961f7b3e5d76835b WatchSource:0}: Error finding container c90abba5781ec90f05ba7a43a43ba2e153fc65e8b9cd125b961f7b3e5d76835b: Status 404 returned error can't find the container with id c90abba5781ec90f05ba7a43a43ba2e153fc65e8b9cd125b961f7b3e5d76835b May 21 18:20:29.343154 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:29.343117 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-wl6zc" event={"ID":"8d7d805d-c4b5-41e6-b395-e9e733b264d3","Type":"ContainerStarted","Data":"9ef637c1a2679fd168371dc04037c7bf5e98847fac9185d61cbdb017c6898b3c"} May 21 18:20:29.343154 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:29.343157 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-wl6zc" event={"ID":"8d7d805d-c4b5-41e6-b395-e9e733b264d3","Type":"ContainerStarted","Data":"c90abba5781ec90f05ba7a43a43ba2e153fc65e8b9cd125b961f7b3e5d76835b"} May 21 18:20:29.361516 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:29.361460 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-wl6zc" podStartSLOduration=1.36144489 podStartE2EDuration="1.36144489s" podCreationTimestamp="2026-05-21 18:20:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:20:29.360829804 +0000 UTC m=+398.924921065" watchObservedRunningTime="2026-05-21 18:20:29.36144489 +0000 UTC m=+398.925536150" May 21 18:20:37.635918 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.635879 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq"] May 21 18:20:37.638852 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.638833 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.642666 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.642633 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 18:20:37.642829 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.642813 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cjd\"" May 21 18:20:37.643524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.643503 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 18:20:37.660972 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.660937 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq"] May 21 18:20:37.696050 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.696010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.696268 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.696082 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-965m6\" (UniqueName: \"kubernetes.io/projected/b22b86fa-7698-4bdd-bdc8-f332a772936c-kube-api-access-965m6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.696268 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.696147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.797651 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.797610 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.797651 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.797654 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-965m6\" (UniqueName: \"kubernetes.io/projected/b22b86fa-7698-4bdd-bdc8-f332a772936c-kube-api-access-965m6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.797833 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.797678 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.798007 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.797985 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.798048 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.798036 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.806528 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.806501 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-965m6\" (UniqueName: \"kubernetes.io/projected/b22b86fa-7698-4bdd-bdc8-f332a772936c-kube-api-access-965m6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:37.948509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:37.948430 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:38.085560 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:38.085536 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq"] May 21 18:20:38.087903 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:20:38.087871 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22b86fa_7698_4bdd_bdc8_f332a772936c.slice/crio-e234285f33bfbb69791b9dc704fd3554c299fcb5c6c35d19b0f16181bd04df8c WatchSource:0}: Error finding container e234285f33bfbb69791b9dc704fd3554c299fcb5c6c35d19b0f16181bd04df8c: Status 404 returned error can't find the container with id e234285f33bfbb69791b9dc704fd3554c299fcb5c6c35d19b0f16181bd04df8c May 21 18:20:38.374372 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:38.374336 2555 generic.go:358] "Generic (PLEG): container finished" podID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerID="cfb8404d0cbc92f0a58a5002e2b6b1acc2a9d7dec1777d5fc6e3454c308ef318" exitCode=0 May 21 18:20:38.374524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:38.374413 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" event={"ID":"b22b86fa-7698-4bdd-bdc8-f332a772936c","Type":"ContainerDied","Data":"cfb8404d0cbc92f0a58a5002e2b6b1acc2a9d7dec1777d5fc6e3454c308ef318"} May 21 18:20:38.374524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:38.374448 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" event={"ID":"b22b86fa-7698-4bdd-bdc8-f332a772936c","Type":"ContainerStarted","Data":"e234285f33bfbb69791b9dc704fd3554c299fcb5c6c35d19b0f16181bd04df8c"} May 21 18:20:39.381611 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:39.381575 2555 generic.go:358] "Generic (PLEG): container finished" podID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerID="b022d2b24046e8148025acf716d714a66c967f5ebb6481b24409eff9c239f5ad" exitCode=0 May 21 18:20:39.381979 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:39.381669 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" event={"ID":"b22b86fa-7698-4bdd-bdc8-f332a772936c","Type":"ContainerDied","Data":"b022d2b24046e8148025acf716d714a66c967f5ebb6481b24409eff9c239f5ad"} May 21 18:20:40.387266 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:40.387224 2555 generic.go:358] "Generic (PLEG): container finished" podID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerID="a30cf0246aae36347685f789d332331abb413fe783ca15594e13d564b6442d14" exitCode=0 May 21 18:20:40.387645 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:40.387308 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" event={"ID":"b22b86fa-7698-4bdd-bdc8-f332a772936c","Type":"ContainerDied","Data":"a30cf0246aae36347685f789d332331abb413fe783ca15594e13d564b6442d14"} May 21 18:20:41.516462 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.516435 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:41.633440 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.633382 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-bundle\") pod \"b22b86fa-7698-4bdd-bdc8-f332a772936c\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " May 21 18:20:41.633440 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.633448 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-965m6\" (UniqueName: \"kubernetes.io/projected/b22b86fa-7698-4bdd-bdc8-f332a772936c-kube-api-access-965m6\") pod \"b22b86fa-7698-4bdd-bdc8-f332a772936c\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " May 21 18:20:41.633690 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.633496 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-util\") pod \"b22b86fa-7698-4bdd-bdc8-f332a772936c\" (UID: \"b22b86fa-7698-4bdd-bdc8-f332a772936c\") " May 21 18:20:41.634122 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.634075 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-bundle" (OuterVolumeSpecName: "bundle") pod "b22b86fa-7698-4bdd-bdc8-f332a772936c" (UID: "b22b86fa-7698-4bdd-bdc8-f332a772936c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:20:41.635511 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.635487 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b22b86fa-7698-4bdd-bdc8-f332a772936c-kube-api-access-965m6" (OuterVolumeSpecName: "kube-api-access-965m6") pod "b22b86fa-7698-4bdd-bdc8-f332a772936c" (UID: "b22b86fa-7698-4bdd-bdc8-f332a772936c"). InnerVolumeSpecName "kube-api-access-965m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:20:41.641929 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.641862 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-util" (OuterVolumeSpecName: "util") pod "b22b86fa-7698-4bdd-bdc8-f332a772936c" (UID: "b22b86fa-7698-4bdd-bdc8-f332a772936c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:20:41.734698 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.734641 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:41.734698 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.734693 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-965m6\" (UniqueName: \"kubernetes.io/projected/b22b86fa-7698-4bdd-bdc8-f332a772936c-kube-api-access-965m6\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:41.734698 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:41.734704 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b22b86fa-7698-4bdd-bdc8-f332a772936c-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:42.395408 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:42.395375 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" event={"ID":"b22b86fa-7698-4bdd-bdc8-f332a772936c","Type":"ContainerDied","Data":"e234285f33bfbb69791b9dc704fd3554c299fcb5c6c35d19b0f16181bd04df8c"} May 21 18:20:42.395408 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:42.395407 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e234285f33bfbb69791b9dc704fd3554c299fcb5c6c35d19b0f16181bd04df8c" May 21 18:20:42.395614 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:42.395425 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vmtbq" May 21 18:20:54.790571 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.790535 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz"] May 21 18:20:54.790975 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.790888 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerName="pull" May 21 18:20:54.790975 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.790903 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerName="pull" May 21 18:20:54.790975 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.790925 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerName="util" May 21 18:20:54.790975 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.790931 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerName="util" May 21 18:20:54.790975 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.790937 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerName="extract" May 21 18:20:54.790975 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.790944 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerName="extract" May 21 18:20:54.791212 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.790996 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b22b86fa-7698-4bdd-bdc8-f332a772936c" containerName="extract" May 21 18:20:54.796540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.796518 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:54.799016 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.798992 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 18:20:54.799168 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.799132 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cjd\"" May 21 18:20:54.799687 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.799671 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 18:20:54.809387 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.809350 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz"] May 21 18:20:54.827349 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.827311 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj"] May 21 18:20:54.829964 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.829947 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:54.834219 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.834198 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 18:20:54.834762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.834739 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xnk8k\"" May 21 18:20:54.834870 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.834744 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 18:20:54.834998 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.834983 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 18:20:54.835076 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.834999 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 18:20:54.877372 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.877325 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj"] May 21 18:20:54.956656 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.956617 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:54.956880 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.956664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjds\" (UniqueName: \"kubernetes.io/projected/dada424a-19cf-40a7-af00-885d805844eb-kube-api-access-5kjds\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:54.956880 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.956796 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:54.956880 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.956837 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:54.956880 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.956866 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rch8q\" (UniqueName: \"kubernetes.io/projected/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-kube-api-access-rch8q\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:54.957066 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:54.956919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:55.057533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.057431 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:55.057533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.057479 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjds\" (UniqueName: \"kubernetes.io/projected/dada424a-19cf-40a7-af00-885d805844eb-kube-api-access-5kjds\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:55.057762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.057623 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:55.057762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.057669 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:55.057762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.057694 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rch8q\" (UniqueName: \"kubernetes.io/projected/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-kube-api-access-rch8q\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:55.057762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.057732 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:55.057967 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.057876 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:55.058019 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.057979 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:55.060644 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.060619 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:55.060793 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.060763 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:55.066719 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.066675 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rch8q\" (UniqueName: \"kubernetes.io/projected/98eb1f16-e403-4cf5-8e1d-f019bd78ebd5-kube-api-access-rch8q\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-zcfvj\" (UID: \"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:55.067368 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.067346 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjds\" (UniqueName: \"kubernetes.io/projected/dada424a-19cf-40a7-af00-885d805844eb-kube-api-access-5kjds\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:55.106187 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.106143 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:55.140083 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.140037 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:55.258794 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.258767 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz"] May 21 18:20:55.261148 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:20:55.261087 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddada424a_19cf_40a7_af00_885d805844eb.slice/crio-bba7787f3948fd171f77e6311a63adaeec33ef52cb8dd74a01217d9f27cd3b8d WatchSource:0}: Error finding container bba7787f3948fd171f77e6311a63adaeec33ef52cb8dd74a01217d9f27cd3b8d: Status 404 returned error can't find the container with id bba7787f3948fd171f77e6311a63adaeec33ef52cb8dd74a01217d9f27cd3b8d May 21 18:20:55.283644 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.283620 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj"] May 21 18:20:55.292482 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:20:55.292434 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98eb1f16_e403_4cf5_8e1d_f019bd78ebd5.slice/crio-300c4def9822bd5c988950a782379348f37bcc14af1aeb007ad69802e67ddd1c WatchSource:0}: Error finding container 300c4def9822bd5c988950a782379348f37bcc14af1aeb007ad69802e67ddd1c: Status 404 returned error can't find the container with id 300c4def9822bd5c988950a782379348f37bcc14af1aeb007ad69802e67ddd1c May 21 18:20:55.439391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.439358 2555 generic.go:358] "Generic (PLEG): container finished" podID="dada424a-19cf-40a7-af00-885d805844eb" containerID="f44ee007f5196fdf32a8293e95d9f733b7afd629075abc9c8e331b7b3e64ec02" exitCode=0 May 21 18:20:55.439577 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.439441 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" event={"ID":"dada424a-19cf-40a7-af00-885d805844eb","Type":"ContainerDied","Data":"f44ee007f5196fdf32a8293e95d9f733b7afd629075abc9c8e331b7b3e64ec02"} May 21 18:20:55.439577 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.439479 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" event={"ID":"dada424a-19cf-40a7-af00-885d805844eb","Type":"ContainerStarted","Data":"bba7787f3948fd171f77e6311a63adaeec33ef52cb8dd74a01217d9f27cd3b8d"} May 21 18:20:55.440708 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:55.440689 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" event={"ID":"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5","Type":"ContainerStarted","Data":"300c4def9822bd5c988950a782379348f37bcc14af1aeb007ad69802e67ddd1c"} May 21 18:20:56.452241 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:56.452145 2555 generic.go:358] "Generic (PLEG): container finished" podID="dada424a-19cf-40a7-af00-885d805844eb" containerID="3bf143c2fa78b21893cd693198aad58b2347a0c182c9c022507b95613f414fa6" exitCode=0 May 21 18:20:56.452699 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:56.452281 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" event={"ID":"dada424a-19cf-40a7-af00-885d805844eb","Type":"ContainerDied","Data":"3bf143c2fa78b21893cd693198aad58b2347a0c182c9c022507b95613f414fa6"} May 21 18:20:57.460963 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:57.460915 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" event={"ID":"dada424a-19cf-40a7-af00-885d805844eb","Type":"ContainerStarted","Data":"cf8a1d0b674d8382e0197cd87f7bb07ad3280ae49df0cdde886eb27210083389"} May 21 18:20:57.484369 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:57.484295 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" podStartSLOduration=2.928975517 podStartE2EDuration="3.484273995s" podCreationTimestamp="2026-05-21 18:20:54 +0000 UTC" firstStartedPulling="2026-05-21 18:20:55.439967755 +0000 UTC m=+425.004058994" lastFinishedPulling="2026-05-21 18:20:55.995266232 +0000 UTC m=+425.559357472" observedRunningTime="2026-05-21 18:20:57.481854714 +0000 UTC m=+427.045946013" watchObservedRunningTime="2026-05-21 18:20:57.484273995 +0000 UTC m=+427.048365286" May 21 18:20:58.467823 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:58.467786 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" event={"ID":"98eb1f16-e403-4cf5-8e1d-f019bd78ebd5","Type":"ContainerStarted","Data":"b9b10f533a0f3d30c6f1d8eded9b97db392eed4239d89f8063ac4339572c5f97"} May 21 18:20:58.468342 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:58.467859 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:20:58.470716 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:58.470683 2555 generic.go:358] "Generic (PLEG): container finished" podID="dada424a-19cf-40a7-af00-885d805844eb" containerID="cf8a1d0b674d8382e0197cd87f7bb07ad3280ae49df0cdde886eb27210083389" exitCode=0 May 21 18:20:58.470835 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:58.470726 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" event={"ID":"dada424a-19cf-40a7-af00-885d805844eb","Type":"ContainerDied","Data":"cf8a1d0b674d8382e0197cd87f7bb07ad3280ae49df0cdde886eb27210083389"} May 21 18:20:58.492331 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:58.492276 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" podStartSLOduration=1.883318236 podStartE2EDuration="4.492260966s" podCreationTimestamp="2026-05-21 18:20:54 +0000 UTC" firstStartedPulling="2026-05-21 18:20:55.294418749 +0000 UTC m=+424.858509988" lastFinishedPulling="2026-05-21 18:20:57.903361478 +0000 UTC m=+427.467452718" observedRunningTime="2026-05-21 18:20:58.490511594 +0000 UTC m=+428.054602875" watchObservedRunningTime="2026-05-21 18:20:58.492260966 +0000 UTC m=+428.056352227" May 21 18:20:59.601562 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.601534 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:20:59.694319 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.694278 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-bundle\") pod \"dada424a-19cf-40a7-af00-885d805844eb\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " May 21 18:20:59.694500 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.694354 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-util\") pod \"dada424a-19cf-40a7-af00-885d805844eb\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " May 21 18:20:59.694500 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.694402 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kjds\" (UniqueName: \"kubernetes.io/projected/dada424a-19cf-40a7-af00-885d805844eb-kube-api-access-5kjds\") pod \"dada424a-19cf-40a7-af00-885d805844eb\" (UID: \"dada424a-19cf-40a7-af00-885d805844eb\") " May 21 18:20:59.695127 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.695068 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-bundle" (OuterVolumeSpecName: "bundle") pod "dada424a-19cf-40a7-af00-885d805844eb" (UID: "dada424a-19cf-40a7-af00-885d805844eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:20:59.696625 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.696605 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dada424a-19cf-40a7-af00-885d805844eb-kube-api-access-5kjds" (OuterVolumeSpecName: "kube-api-access-5kjds") pod "dada424a-19cf-40a7-af00-885d805844eb" (UID: "dada424a-19cf-40a7-af00-885d805844eb"). InnerVolumeSpecName "kube-api-access-5kjds". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:20:59.701723 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.701688 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-util" (OuterVolumeSpecName: "util") pod "dada424a-19cf-40a7-af00-885d805844eb" (UID: "dada424a-19cf-40a7-af00-885d805844eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:20:59.795599 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.795513 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:59.795599 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.795543 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kjds\" (UniqueName: \"kubernetes.io/projected/dada424a-19cf-40a7-af00-885d805844eb-kube-api-access-5kjds\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:20:59.795599 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:20:59.795555 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dada424a-19cf-40a7-af00-885d805844eb-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:21:00.479326 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.479294 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" May 21 18:21:00.479530 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.479293 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c99gfxz" event={"ID":"dada424a-19cf-40a7-af00-885d805844eb","Type":"ContainerDied","Data":"bba7787f3948fd171f77e6311a63adaeec33ef52cb8dd74a01217d9f27cd3b8d"} May 21 18:21:00.479530 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.479403 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bba7787f3948fd171f77e6311a63adaeec33ef52cb8dd74a01217d9f27cd3b8d" May 21 18:21:00.492095 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.492067 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp"] May 21 18:21:00.492571 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.492541 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dada424a-19cf-40a7-af00-885d805844eb" containerName="pull" May 21 18:21:00.492571 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.492565 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dada424a-19cf-40a7-af00-885d805844eb" containerName="pull" May 21 18:21:00.492738 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.492598 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dada424a-19cf-40a7-af00-885d805844eb" containerName="extract" May 21 18:21:00.492738 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.492606 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dada424a-19cf-40a7-af00-885d805844eb" containerName="extract" May 21 18:21:00.492738 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.492617 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dada424a-19cf-40a7-af00-885d805844eb" containerName="util" May 21 18:21:00.492738 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.492623 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dada424a-19cf-40a7-af00-885d805844eb" containerName="util" May 21 18:21:00.492738 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.492683 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="dada424a-19cf-40a7-af00-885d805844eb" containerName="extract" May 21 18:21:00.497136 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.497099 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.501099 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.501074 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 18:21:00.501229 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.501138 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 18:21:00.501584 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.501567 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 18:21:00.501692 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.501646 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 18:21:00.501890 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.501876 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vwdrg\"" May 21 18:21:00.502002 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.501988 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 18:21:00.502247 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.502229 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/34680e2d-1763-4907-9041-7f39a447fcff-manager-config\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.502326 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.502269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4rz\" (UniqueName: \"kubernetes.io/projected/34680e2d-1763-4907-9041-7f39a447fcff-kube-api-access-wj4rz\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.502326 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.502291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/34680e2d-1763-4907-9041-7f39a447fcff-metrics-cert\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.502429 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.502340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34680e2d-1763-4907-9041-7f39a447fcff-cert\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.515132 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.515085 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp"] May 21 18:21:00.603078 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.603039 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/34680e2d-1763-4907-9041-7f39a447fcff-manager-config\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.603078 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.603086 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4rz\" (UniqueName: \"kubernetes.io/projected/34680e2d-1763-4907-9041-7f39a447fcff-kube-api-access-wj4rz\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.603631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.603129 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/34680e2d-1763-4907-9041-7f39a447fcff-metrics-cert\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.603631 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.603147 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34680e2d-1763-4907-9041-7f39a447fcff-cert\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.603890 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.603866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/34680e2d-1763-4907-9041-7f39a447fcff-manager-config\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.605656 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.605633 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/34680e2d-1763-4907-9041-7f39a447fcff-metrics-cert\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.605656 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.605649 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34680e2d-1763-4907-9041-7f39a447fcff-cert\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.614358 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.614336 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4rz\" (UniqueName: \"kubernetes.io/projected/34680e2d-1763-4907-9041-7f39a447fcff-kube-api-access-wj4rz\") pod \"lws-controller-manager-99f48c84-vtwkp\" (UID: \"34680e2d-1763-4907-9041-7f39a447fcff\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.807018 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.806916 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:00.974199 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:00.974175 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp"] May 21 18:21:00.976577 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:21:00.976550 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34680e2d_1763_4907_9041_7f39a447fcff.slice/crio-6388e6d5c689470682e2db8d51fcfe5fde049088bcd30a06d4c839ccaa6aa7eb WatchSource:0}: Error finding container 6388e6d5c689470682e2db8d51fcfe5fde049088bcd30a06d4c839ccaa6aa7eb: Status 404 returned error can't find the container with id 6388e6d5c689470682e2db8d51fcfe5fde049088bcd30a06d4c839ccaa6aa7eb May 21 18:21:01.484140 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:01.484084 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" event={"ID":"34680e2d-1763-4907-9041-7f39a447fcff","Type":"ContainerStarted","Data":"6388e6d5c689470682e2db8d51fcfe5fde049088bcd30a06d4c839ccaa6aa7eb"} May 21 18:21:03.492398 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:03.492362 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" event={"ID":"34680e2d-1763-4907-9041-7f39a447fcff","Type":"ContainerStarted","Data":"4a4ac2b9ed8ce89c468a6fe40fd96b23273f5b8af7a16c9f113497c8301e5e7d"} May 21 18:21:03.492798 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:03.492429 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:03.510573 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:03.510515 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" podStartSLOduration=1.958923932 podStartE2EDuration="3.510498582s" podCreationTimestamp="2026-05-21 18:21:00 +0000 UTC" firstStartedPulling="2026-05-21 18:21:00.978276353 +0000 UTC m=+430.542367596" lastFinishedPulling="2026-05-21 18:21:02.529851002 +0000 UTC m=+432.093942246" observedRunningTime="2026-05-21 18:21:03.508700293 +0000 UTC m=+433.072791554" watchObservedRunningTime="2026-05-21 18:21:03.510498582 +0000 UTC m=+433.074589842" May 21 18:21:09.476730 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:09.476656 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-zcfvj" May 21 18:21:14.497932 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:14.497899 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-99f48c84-vtwkp" May 21 18:21:22.954268 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:22.954230 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql"] May 21 18:21:22.957513 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:22.957496 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:22.959832 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:22.959809 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 18:21:22.959962 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:22.959814 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 18:21:22.960617 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:22.960599 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cjd\"" May 21 18:21:22.978189 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:22.978160 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql"] May 21 18:21:23.105094 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.105052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.105394 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.105358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5h4t\" (UniqueName: \"kubernetes.io/projected/68d28ae8-ba62-4ad3-8734-75933f86bf7e-kube-api-access-z5h4t\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.105520 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.105430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.206532 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.206448 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5h4t\" (UniqueName: \"kubernetes.io/projected/68d28ae8-ba62-4ad3-8734-75933f86bf7e-kube-api-access-z5h4t\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.206532 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.206515 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.206772 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.206598 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.206996 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.206971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.206996 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.206988 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.221850 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.221816 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5h4t\" (UniqueName: \"kubernetes.io/projected/68d28ae8-ba62-4ad3-8734-75933f86bf7e-kube-api-access-z5h4t\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.266500 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.266462 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:23.421515 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.421486 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql"] May 21 18:21:23.423262 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:21:23.423226 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d28ae8_ba62_4ad3_8734_75933f86bf7e.slice/crio-12e94223b4daf5eca22a32dca32d6dcb7fb3b41c7ac3912394f41af1e9ce3d83 WatchSource:0}: Error finding container 12e94223b4daf5eca22a32dca32d6dcb7fb3b41c7ac3912394f41af1e9ce3d83: Status 404 returned error can't find the container with id 12e94223b4daf5eca22a32dca32d6dcb7fb3b41c7ac3912394f41af1e9ce3d83 May 21 18:21:23.565485 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.565443 2555 generic.go:358] "Generic (PLEG): container finished" podID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerID="bb678b117b836d819514407e38998098031a95972fbdae36cdcc8da1aa7464fe" exitCode=0 May 21 18:21:23.565649 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.565524 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" event={"ID":"68d28ae8-ba62-4ad3-8734-75933f86bf7e","Type":"ContainerDied","Data":"bb678b117b836d819514407e38998098031a95972fbdae36cdcc8da1aa7464fe"} May 21 18:21:23.565649 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:23.565557 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" event={"ID":"68d28ae8-ba62-4ad3-8734-75933f86bf7e","Type":"ContainerStarted","Data":"12e94223b4daf5eca22a32dca32d6dcb7fb3b41c7ac3912394f41af1e9ce3d83"} May 21 18:21:25.573812 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:25.573776 2555 generic.go:358] "Generic (PLEG): container finished" podID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerID="3e50f7f7aff0ae0867d00faa8019f8a8c2c95e1e61c8567c92fa84d8ba4cf9ec" exitCode=0 May 21 18:21:25.574216 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:25.573841 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" event={"ID":"68d28ae8-ba62-4ad3-8734-75933f86bf7e","Type":"ContainerDied","Data":"3e50f7f7aff0ae0867d00faa8019f8a8c2c95e1e61c8567c92fa84d8ba4cf9ec"} May 21 18:21:26.578830 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:26.578793 2555 generic.go:358] "Generic (PLEG): container finished" podID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerID="e669f8fadeb5c94dfb872a4c1efccf7717998da6c9619352e8bcb107ee419bdb" exitCode=0 May 21 18:21:26.579218 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:26.578872 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" event={"ID":"68d28ae8-ba62-4ad3-8734-75933f86bf7e","Type":"ContainerDied","Data":"e669f8fadeb5c94dfb872a4c1efccf7717998da6c9619352e8bcb107ee419bdb"} May 21 18:21:27.708006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.707980 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:27.846546 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.846454 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-bundle\") pod \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " May 21 18:21:27.846546 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.846495 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-util\") pod \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " May 21 18:21:27.846546 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.846524 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5h4t\" (UniqueName: \"kubernetes.io/projected/68d28ae8-ba62-4ad3-8734-75933f86bf7e-kube-api-access-z5h4t\") pod \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\" (UID: \"68d28ae8-ba62-4ad3-8734-75933f86bf7e\") " May 21 18:21:27.847637 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.847595 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-bundle" (OuterVolumeSpecName: "bundle") pod "68d28ae8-ba62-4ad3-8734-75933f86bf7e" (UID: "68d28ae8-ba62-4ad3-8734-75933f86bf7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:21:27.848710 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.848686 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d28ae8-ba62-4ad3-8734-75933f86bf7e-kube-api-access-z5h4t" (OuterVolumeSpecName: "kube-api-access-z5h4t") pod "68d28ae8-ba62-4ad3-8734-75933f86bf7e" (UID: "68d28ae8-ba62-4ad3-8734-75933f86bf7e"). InnerVolumeSpecName "kube-api-access-z5h4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:21:27.852763 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.852724 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-util" (OuterVolumeSpecName: "util") pod "68d28ae8-ba62-4ad3-8734-75933f86bf7e" (UID: "68d28ae8-ba62-4ad3-8734-75933f86bf7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:21:27.947977 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.947938 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:21:27.947977 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.947969 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68d28ae8-ba62-4ad3-8734-75933f86bf7e-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:21:27.947977 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:27.947979 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5h4t\" (UniqueName: \"kubernetes.io/projected/68d28ae8-ba62-4ad3-8734-75933f86bf7e-kube-api-access-z5h4t\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:21:28.587334 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:28.587304 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" May 21 18:21:28.587547 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:28.587305 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tz8ql" event={"ID":"68d28ae8-ba62-4ad3-8734-75933f86bf7e","Type":"ContainerDied","Data":"12e94223b4daf5eca22a32dca32d6dcb7fb3b41c7ac3912394f41af1e9ce3d83"} May 21 18:21:28.587547 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:28.587415 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12e94223b4daf5eca22a32dca32d6dcb7fb3b41c7ac3912394f41af1e9ce3d83" May 21 18:21:36.975006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.974961 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59"] May 21 18:21:36.975552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.975310 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerName="extract" May 21 18:21:36.975552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.975322 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerName="extract" May 21 18:21:36.975552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.975344 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerName="pull" May 21 18:21:36.975552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.975349 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerName="pull" May 21 18:21:36.975552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.975363 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerName="util" May 21 18:21:36.975552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.975371 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerName="util" May 21 18:21:36.975552 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.975427 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="68d28ae8-ba62-4ad3-8734-75933f86bf7e" containerName="extract" May 21 18:21:36.982427 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.982395 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:36.984848 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.984817 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 18:21:36.985688 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.985672 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cjd\"" May 21 18:21:36.985772 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.985692 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 18:21:36.997369 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:36.997335 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59"] May 21 18:21:37.126421 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.126376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.126598 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.126426 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.126598 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.126556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xztmk\" (UniqueName: \"kubernetes.io/projected/40251622-b40f-4fcc-a114-d8184b138d6a-kube-api-access-xztmk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.227647 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.227548 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.227647 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.227612 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.227862 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.227695 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xztmk\" (UniqueName: \"kubernetes.io/projected/40251622-b40f-4fcc-a114-d8184b138d6a-kube-api-access-xztmk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.227964 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.227943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.228019 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.227973 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.263852 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.263822 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xztmk\" (UniqueName: \"kubernetes.io/projected/40251622-b40f-4fcc-a114-d8184b138d6a-kube-api-access-xztmk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.294611 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.294577 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:37.447487 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.447445 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59"] May 21 18:21:37.453640 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:21:37.453612 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40251622_b40f_4fcc_a114_d8184b138d6a.slice/crio-3c658804750b2c5ea740b2c9a2a4a870e2b799251129d78c9d5eb5df12e744f5 WatchSource:0}: Error finding container 3c658804750b2c5ea740b2c9a2a4a870e2b799251129d78c9d5eb5df12e744f5: Status 404 returned error can't find the container with id 3c658804750b2c5ea740b2c9a2a4a870e2b799251129d78c9d5eb5df12e744f5 May 21 18:21:37.618967 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.618936 2555 generic.go:358] "Generic (PLEG): container finished" podID="40251622-b40f-4fcc-a114-d8184b138d6a" containerID="49a92ac443224f1080c5f90b24cfbc770ac1f0e5119d98e3bae3387d7d2e6ed6" exitCode=0 May 21 18:21:37.619136 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.618991 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" event={"ID":"40251622-b40f-4fcc-a114-d8184b138d6a","Type":"ContainerDied","Data":"49a92ac443224f1080c5f90b24cfbc770ac1f0e5119d98e3bae3387d7d2e6ed6"} May 21 18:21:37.619136 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:37.619014 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" event={"ID":"40251622-b40f-4fcc-a114-d8184b138d6a","Type":"ContainerStarted","Data":"3c658804750b2c5ea740b2c9a2a4a870e2b799251129d78c9d5eb5df12e744f5"} May 21 18:21:39.627659 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:39.627620 2555 generic.go:358] "Generic (PLEG): container finished" podID="40251622-b40f-4fcc-a114-d8184b138d6a" containerID="3d14c9fa7153868f648d883c00a391728ece35754c630193e764d586946686dc" exitCode=0 May 21 18:21:39.628043 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:39.627684 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" event={"ID":"40251622-b40f-4fcc-a114-d8184b138d6a","Type":"ContainerDied","Data":"3d14c9fa7153868f648d883c00a391728ece35754c630193e764d586946686dc"} May 21 18:21:40.633527 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:40.633483 2555 generic.go:358] "Generic (PLEG): container finished" podID="40251622-b40f-4fcc-a114-d8184b138d6a" containerID="4731e1cf3e7e373d40a6636a40abeaacae8c397f064b7eacbf26fa6a9fd8e270" exitCode=0 May 21 18:21:40.633923 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:40.633570 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" event={"ID":"40251622-b40f-4fcc-a114-d8184b138d6a","Type":"ContainerDied","Data":"4731e1cf3e7e373d40a6636a40abeaacae8c397f064b7eacbf26fa6a9fd8e270"} May 21 18:21:41.761085 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.761059 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:41.868366 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.868328 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-util\") pod \"40251622-b40f-4fcc-a114-d8184b138d6a\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " May 21 18:21:41.868540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.868383 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xztmk\" (UniqueName: \"kubernetes.io/projected/40251622-b40f-4fcc-a114-d8184b138d6a-kube-api-access-xztmk\") pod \"40251622-b40f-4fcc-a114-d8184b138d6a\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " May 21 18:21:41.868540 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.868425 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-bundle\") pod \"40251622-b40f-4fcc-a114-d8184b138d6a\" (UID: \"40251622-b40f-4fcc-a114-d8184b138d6a\") " May 21 18:21:41.869696 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.869669 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-bundle" (OuterVolumeSpecName: "bundle") pod "40251622-b40f-4fcc-a114-d8184b138d6a" (UID: "40251622-b40f-4fcc-a114-d8184b138d6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:21:41.870512 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.870487 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40251622-b40f-4fcc-a114-d8184b138d6a-kube-api-access-xztmk" (OuterVolumeSpecName: "kube-api-access-xztmk") pod "40251622-b40f-4fcc-a114-d8184b138d6a" (UID: "40251622-b40f-4fcc-a114-d8184b138d6a"). InnerVolumeSpecName "kube-api-access-xztmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:21:41.874841 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.874814 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-util" (OuterVolumeSpecName: "util") pod "40251622-b40f-4fcc-a114-d8184b138d6a" (UID: "40251622-b40f-4fcc-a114-d8184b138d6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:21:41.970164 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.970135 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:21:41.970164 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.970163 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40251622-b40f-4fcc-a114-d8184b138d6a-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:21:41.970358 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:41.970178 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xztmk\" (UniqueName: \"kubernetes.io/projected/40251622-b40f-4fcc-a114-d8184b138d6a-kube-api-access-xztmk\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:21:42.642270 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:42.642234 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" event={"ID":"40251622-b40f-4fcc-a114-d8184b138d6a","Type":"ContainerDied","Data":"3c658804750b2c5ea740b2c9a2a4a870e2b799251129d78c9d5eb5df12e744f5"} May 21 18:21:42.642270 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:42.642272 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c658804750b2c5ea740b2c9a2a4a870e2b799251129d78c9d5eb5df12e744f5" May 21 18:21:42.642477 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:42.642277 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4h59" May 21 18:21:58.834412 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.834074 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5"] May 21 18:21:58.835087 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.834565 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40251622-b40f-4fcc-a114-d8184b138d6a" containerName="pull" May 21 18:21:58.835087 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.834584 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="40251622-b40f-4fcc-a114-d8184b138d6a" containerName="pull" May 21 18:21:58.835087 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.834605 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40251622-b40f-4fcc-a114-d8184b138d6a" containerName="util" May 21 18:21:58.835087 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.834613 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="40251622-b40f-4fcc-a114-d8184b138d6a" containerName="util" May 21 18:21:58.835087 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.834630 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40251622-b40f-4fcc-a114-d8184b138d6a" containerName="extract" May 21 18:21:58.835087 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.834638 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="40251622-b40f-4fcc-a114-d8184b138d6a" containerName="extract" May 21 18:21:58.835087 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.834733 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="40251622-b40f-4fcc-a114-d8184b138d6a" containerName="extract" May 21 18:21:58.839270 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.839245 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.841603 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.841573 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bwdh7\"" May 21 18:21:58.841715 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.841575 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 18:21:58.853717 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.853678 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5"] May 21 18:21:58.915917 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.915878 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.915917 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.915922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.916145 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.915995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.916145 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.916018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.916145 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.916040 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.916145 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.916060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.916145 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.916100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.916302 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.916177 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:58.916302 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:58.916213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmgq\" (UniqueName: \"kubernetes.io/projected/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-kube-api-access-qcmgq\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017326 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017290 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017344 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017379 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017407 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017509 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017463 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017709 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017518 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmgq\" (UniqueName: \"kubernetes.io/projected/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-kube-api-access-qcmgq\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017709 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017590 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017709 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017623 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017709 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017669 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017895 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017777 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.017895 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.017804 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.018041 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.018020 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.018096 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.018056 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.018245 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.018226 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.020774 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.020749 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.021334 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.021311 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.028308 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.028284 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.028891 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.028871 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmgq\" (UniqueName: \"kubernetes.io/projected/b3d5f384-3a9d-4aa4-b80f-e6a09976b969-kube-api-access-qcmgq\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b97kw5\" (UID: \"b3d5f384-3a9d-4aa4-b80f-e6a09976b969\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.150997 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.150913 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:21:59.293150 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.293091 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5"] May 21 18:21:59.293748 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:21:59.293726 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d5f384_3a9d_4aa4_b80f_e6a09976b969.slice/crio-b194feb783a85c989c70cc40a23f8d2110b36fb65f18f0e00a53f9120dbfecca WatchSource:0}: Error finding container b194feb783a85c989c70cc40a23f8d2110b36fb65f18f0e00a53f9120dbfecca: Status 404 returned error can't find the container with id b194feb783a85c989c70cc40a23f8d2110b36fb65f18f0e00a53f9120dbfecca May 21 18:21:59.702682 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:21:59.702636 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" event={"ID":"b3d5f384-3a9d-4aa4-b80f-e6a09976b969","Type":"ContainerStarted","Data":"b194feb783a85c989c70cc40a23f8d2110b36fb65f18f0e00a53f9120dbfecca"} May 21 18:22:01.888372 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:01.888333 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 18:22:01.888672 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:01.888426 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 18:22:01.888672 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:01.888455 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 18:22:02.715433 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:02.715399 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" event={"ID":"b3d5f384-3a9d-4aa4-b80f-e6a09976b969","Type":"ContainerStarted","Data":"54260571a46fbbe38d7d87c5028c37c99887f0ea9ef63bbaf8e8a18d9edcacd1"} May 21 18:22:02.739071 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:02.739010 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" podStartSLOduration=2.146602354 podStartE2EDuration="4.738991916s" podCreationTimestamp="2026-05-21 18:21:58 +0000 UTC" firstStartedPulling="2026-05-21 18:21:59.295636698 +0000 UTC m=+488.859727941" lastFinishedPulling="2026-05-21 18:22:01.888026264 +0000 UTC m=+491.452117503" observedRunningTime="2026-05-21 18:22:02.738130024 +0000 UTC m=+492.302221280" watchObservedRunningTime="2026-05-21 18:22:02.738991916 +0000 UTC m=+492.303083189" May 21 18:22:03.151930 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:03.151886 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:22:03.160838 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:03.160806 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:22:03.719177 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:03.719149 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:22:03.720338 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:03.720312 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b97kw5" May 21 18:22:13.149268 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.149232 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hfpz6"] May 21 18:22:13.152846 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.152828 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:13.155963 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.155939 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 18:22:13.156096 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.155943 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 18:22:13.156605 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.156588 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6t7j8\"" May 21 18:22:13.168095 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.168057 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hfpz6"] May 21 18:22:13.250595 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.250546 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnqhl\" (UniqueName: \"kubernetes.io/projected/ba25eebd-7530-4ed8-a7d1-1d087694f85f-kube-api-access-nnqhl\") pod \"kuadrant-operator-catalog-hfpz6\" (UID: \"ba25eebd-7530-4ed8-a7d1-1d087694f85f\") " pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:13.351024 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.350985 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnqhl\" (UniqueName: \"kubernetes.io/projected/ba25eebd-7530-4ed8-a7d1-1d087694f85f-kube-api-access-nnqhl\") pod \"kuadrant-operator-catalog-hfpz6\" (UID: \"ba25eebd-7530-4ed8-a7d1-1d087694f85f\") " pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:13.365656 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.365629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnqhl\" (UniqueName: \"kubernetes.io/projected/ba25eebd-7530-4ed8-a7d1-1d087694f85f-kube-api-access-nnqhl\") pod \"kuadrant-operator-catalog-hfpz6\" (UID: \"ba25eebd-7530-4ed8-a7d1-1d087694f85f\") " pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:13.462305 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.462209 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:13.617242 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.617213 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hfpz6"] May 21 18:22:13.618953 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:13.618919 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba25eebd_7530_4ed8_a7d1_1d087694f85f.slice/crio-7a57adb23c57b61964cf44c030cad5c50cd7287fae23b17d98ce8d5c91c49989 WatchSource:0}: Error finding container 7a57adb23c57b61964cf44c030cad5c50cd7287fae23b17d98ce8d5c91c49989: Status 404 returned error can't find the container with id 7a57adb23c57b61964cf44c030cad5c50cd7287fae23b17d98ce8d5c91c49989 May 21 18:22:13.755002 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:13.754955 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" event={"ID":"ba25eebd-7530-4ed8-a7d1-1d087694f85f","Type":"ContainerStarted","Data":"7a57adb23c57b61964cf44c030cad5c50cd7287fae23b17d98ce8d5c91c49989"} May 21 18:22:15.764930 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:15.764885 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" event={"ID":"ba25eebd-7530-4ed8-a7d1-1d087694f85f","Type":"ContainerStarted","Data":"d33bd954df20e4e443c12ce0ce69dcb5f480f9ddad116790cc3ebcb6e9a01d02"} May 21 18:22:15.816415 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:15.816363 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" podStartSLOduration=0.862089474 podStartE2EDuration="2.816347889s" podCreationTimestamp="2026-05-21 18:22:13 +0000 UTC" firstStartedPulling="2026-05-21 18:22:13.620305164 +0000 UTC m=+503.184396402" lastFinishedPulling="2026-05-21 18:22:15.57456357 +0000 UTC m=+505.138654817" observedRunningTime="2026-05-21 18:22:15.813424383 +0000 UTC m=+505.377515643" watchObservedRunningTime="2026-05-21 18:22:15.816347889 +0000 UTC m=+505.380439149" May 21 18:22:23.463233 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:23.463191 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:23.463233 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:23.463241 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:23.485803 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:23.485770 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:23.815902 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:23.815870 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hfpz6" May 21 18:22:28.417197 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.417158 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8"] May 21 18:22:28.420896 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.420879 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.424313 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.424290 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hh95b\"" May 21 18:22:28.443206 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.443166 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8"] May 21 18:22:28.587946 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.587904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.587946 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.587948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp695\" (UniqueName: \"kubernetes.io/projected/8eac61bd-c080-44da-92c8-e22b19a7cc44-kube-api-access-zp695\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.588245 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.588077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.689334 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.689232 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.689334 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.689281 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zp695\" (UniqueName: \"kubernetes.io/projected/8eac61bd-c080-44da-92c8-e22b19a7cc44-kube-api-access-zp695\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.689563 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.689347 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.689692 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.689668 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.689731 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.689680 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.699567 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.699535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp695\" (UniqueName: \"kubernetes.io/projected/8eac61bd-c080-44da-92c8-e22b19a7cc44-kube-api-access-zp695\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.730386 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.730345 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:28.875276 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:28.875246 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8"] May 21 18:22:28.878328 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:28.878302 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eac61bd_c080_44da_92c8_e22b19a7cc44.slice/crio-1490f4aa42a825eca40cf66e080fa217a630e983ede4970a0390404f19dc07f5 WatchSource:0}: Error finding container 1490f4aa42a825eca40cf66e080fa217a630e983ede4970a0390404f19dc07f5: Status 404 returned error can't find the container with id 1490f4aa42a825eca40cf66e080fa217a630e983ede4970a0390404f19dc07f5 May 21 18:22:29.191078 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.191041 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6"] May 21 18:22:29.194680 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.194619 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.208044 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.208015 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6"] May 21 18:22:29.294830 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.294780 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.294830 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.294840 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.295045 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.294915 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9n9p\" (UniqueName: \"kubernetes.io/projected/60da7a16-3989-4e55-8131-01bab1f37b5c-kube-api-access-v9n9p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.396075 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.396036 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.396257 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.396095 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9n9p\" (UniqueName: \"kubernetes.io/projected/60da7a16-3989-4e55-8131-01bab1f37b5c-kube-api-access-v9n9p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.396257 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.396206 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.396558 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.396537 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.396595 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.396547 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.405636 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.405615 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9n9p\" (UniqueName: \"kubernetes.io/projected/60da7a16-3989-4e55-8131-01bab1f37b5c-kube-api-access-v9n9p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.503373 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.503329 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:29.611038 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.611005 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n"] May 21 18:22:29.616027 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.616000 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.634245 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.634215 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n"] May 21 18:22:29.652197 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.652166 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6"] May 21 18:22:29.654784 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:29.654756 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60da7a16_3989_4e55_8131_01bab1f37b5c.slice/crio-09a597b2a95fb98089715435c6a4f79cba749653ba8cd4c5e574a43e5e83ae36 WatchSource:0}: Error finding container 09a597b2a95fb98089715435c6a4f79cba749653ba8cd4c5e574a43e5e83ae36: Status 404 returned error can't find the container with id 09a597b2a95fb98089715435c6a4f79cba749653ba8cd4c5e574a43e5e83ae36 May 21 18:22:29.800602 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.800564 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.800602 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.800605 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxpv2\" (UniqueName: \"kubernetes.io/projected/8a67a799-b79e-467b-8fb2-0877392b2dc5-kube-api-access-cxpv2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.800810 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.800742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.818193 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.818157 2555 generic.go:358] "Generic (PLEG): container finished" podID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerID="e1a97b6e6480608b63747809010b0a7e07c5fe20502d944dd3d9d6a4ed069a58" exitCode=0 May 21 18:22:29.818382 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.818247 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" event={"ID":"60da7a16-3989-4e55-8131-01bab1f37b5c","Type":"ContainerDied","Data":"e1a97b6e6480608b63747809010b0a7e07c5fe20502d944dd3d9d6a4ed069a58"} May 21 18:22:29.818382 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.818287 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" event={"ID":"60da7a16-3989-4e55-8131-01bab1f37b5c","Type":"ContainerStarted","Data":"09a597b2a95fb98089715435c6a4f79cba749653ba8cd4c5e574a43e5e83ae36"} May 21 18:22:29.819861 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.819835 2555 generic.go:358] "Generic (PLEG): container finished" podID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerID="97f2bb47d972617c21b72022d238262db32a8158ed10c0744a82a92a4bb5e74d" exitCode=0 May 21 18:22:29.819963 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.819872 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" event={"ID":"8eac61bd-c080-44da-92c8-e22b19a7cc44","Type":"ContainerDied","Data":"97f2bb47d972617c21b72022d238262db32a8158ed10c0744a82a92a4bb5e74d"} May 21 18:22:29.819963 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.819898 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" event={"ID":"8eac61bd-c080-44da-92c8-e22b19a7cc44","Type":"ContainerStarted","Data":"1490f4aa42a825eca40cf66e080fa217a630e983ede4970a0390404f19dc07f5"} May 21 18:22:29.901480 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.901440 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.901660 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.901486 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxpv2\" (UniqueName: \"kubernetes.io/projected/8a67a799-b79e-467b-8fb2-0877392b2dc5-kube-api-access-cxpv2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.901660 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.901587 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.901875 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.901857 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.901932 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.901909 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.910483 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.910460 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxpv2\" (UniqueName: \"kubernetes.io/projected/8a67a799-b79e-467b-8fb2-0877392b2dc5-kube-api-access-cxpv2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.926435 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.926403 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:29.984250 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.984214 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4"] May 21 18:22:29.989413 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.989385 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:29.995431 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:29.995394 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4"] May 21 18:22:30.065510 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.065482 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n"] May 21 18:22:30.067273 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:30.067242 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a67a799_b79e_467b_8fb2_0877392b2dc5.slice/crio-ba95c4ab184082306a1c9a6c0ba02b4e1ae53e96ba71a4137985b2a1f6fff6fc WatchSource:0}: Error finding container ba95c4ab184082306a1c9a6c0ba02b4e1ae53e96ba71a4137985b2a1f6fff6fc: Status 404 returned error can't find the container with id ba95c4ab184082306a1c9a6c0ba02b4e1ae53e96ba71a4137985b2a1f6fff6fc May 21 18:22:30.102838 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.102806 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.102968 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.102877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.102968 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.102903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9z9x\" (UniqueName: \"kubernetes.io/projected/3e9f1004-e91c-47d1-a509-5ef0336a5c00-kube-api-access-d9z9x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.204215 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.204174 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.204389 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.204248 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.204389 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.204270 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9z9x\" (UniqueName: \"kubernetes.io/projected/3e9f1004-e91c-47d1-a509-5ef0336a5c00-kube-api-access-d9z9x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.204583 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.204558 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.204627 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.204585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.213841 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.213816 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9z9x\" (UniqueName: \"kubernetes.io/projected/3e9f1004-e91c-47d1-a509-5ef0336a5c00-kube-api-access-d9z9x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.301710 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.301606 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:30.438329 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.438299 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4"] May 21 18:22:30.456403 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:30.456366 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9f1004_e91c_47d1_a509_5ef0336a5c00.slice/crio-707e9ff78cfa617694d01c9a277f922b11eefc215a07f0f316107601dfeed4a8 WatchSource:0}: Error finding container 707e9ff78cfa617694d01c9a277f922b11eefc215a07f0f316107601dfeed4a8: Status 404 returned error can't find the container with id 707e9ff78cfa617694d01c9a277f922b11eefc215a07f0f316107601dfeed4a8 May 21 18:22:30.827285 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.827226 2555 generic.go:358] "Generic (PLEG): container finished" podID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerID="c63aaed52d777cf2b4913d246f0c51ae2103aeee24027d40227fa25cc4679c7c" exitCode=0 May 21 18:22:30.827675 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.827325 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" event={"ID":"3e9f1004-e91c-47d1-a509-5ef0336a5c00","Type":"ContainerDied","Data":"c63aaed52d777cf2b4913d246f0c51ae2103aeee24027d40227fa25cc4679c7c"} May 21 18:22:30.827675 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.827357 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" event={"ID":"3e9f1004-e91c-47d1-a509-5ef0336a5c00","Type":"ContainerStarted","Data":"707e9ff78cfa617694d01c9a277f922b11eefc215a07f0f316107601dfeed4a8"} May 21 18:22:30.829275 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.829240 2555 generic.go:358] "Generic (PLEG): container finished" podID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerID="c5a914556a896da2daaf2ad3165f8b1dbd3df6f19c20b57b0d20af8b72e06c67" exitCode=0 May 21 18:22:30.829393 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.829291 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" event={"ID":"8a67a799-b79e-467b-8fb2-0877392b2dc5","Type":"ContainerDied","Data":"c5a914556a896da2daaf2ad3165f8b1dbd3df6f19c20b57b0d20af8b72e06c67"} May 21 18:22:30.829393 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.829320 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" event={"ID":"8a67a799-b79e-467b-8fb2-0877392b2dc5","Type":"ContainerStarted","Data":"ba95c4ab184082306a1c9a6c0ba02b4e1ae53e96ba71a4137985b2a1f6fff6fc"} May 21 18:22:30.831347 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.831323 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" event={"ID":"60da7a16-3989-4e55-8131-01bab1f37b5c","Type":"ContainerStarted","Data":"69b916f47ae3867971b742d272c79be1a94a5120b73fd292f25b8723a4d7436c"} May 21 18:22:30.833325 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:30.833300 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" event={"ID":"8eac61bd-c080-44da-92c8-e22b19a7cc44","Type":"ContainerStarted","Data":"f820a64f2ab2551475c7e2a0b489c1107a117bc76ee8736bf93e251d257f11db"} May 21 18:22:31.839200 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.839162 2555 generic.go:358] "Generic (PLEG): container finished" podID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerID="82bbb80d62f956ab55e0e20247020962473fe4d6faf61d5dd91e5e16c2f1d865" exitCode=0 May 21 18:22:31.839635 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.839252 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" event={"ID":"3e9f1004-e91c-47d1-a509-5ef0336a5c00","Type":"ContainerDied","Data":"82bbb80d62f956ab55e0e20247020962473fe4d6faf61d5dd91e5e16c2f1d865"} May 21 18:22:31.840991 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.840908 2555 generic.go:358] "Generic (PLEG): container finished" podID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerID="22dfb2ee91a7f0930393104253c26472b24d38589cd59ed3a8eb386c0c7a7098" exitCode=0 May 21 18:22:31.841063 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.840988 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" event={"ID":"8a67a799-b79e-467b-8fb2-0877392b2dc5","Type":"ContainerDied","Data":"22dfb2ee91a7f0930393104253c26472b24d38589cd59ed3a8eb386c0c7a7098"} May 21 18:22:31.842773 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.842747 2555 generic.go:358] "Generic (PLEG): container finished" podID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerID="69b916f47ae3867971b742d272c79be1a94a5120b73fd292f25b8723a4d7436c" exitCode=0 May 21 18:22:31.842866 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.842776 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" event={"ID":"60da7a16-3989-4e55-8131-01bab1f37b5c","Type":"ContainerDied","Data":"69b916f47ae3867971b742d272c79be1a94a5120b73fd292f25b8723a4d7436c"} May 21 18:22:31.845059 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.844986 2555 generic.go:358] "Generic (PLEG): container finished" podID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerID="f820a64f2ab2551475c7e2a0b489c1107a117bc76ee8736bf93e251d257f11db" exitCode=0 May 21 18:22:31.845059 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.845006 2555 generic.go:358] "Generic (PLEG): container finished" podID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerID="9f29f16bdd3383d18812fb5effc1e35a413c79d9111f4a907a8c75a0240effd8" exitCode=0 May 21 18:22:31.845185 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.845065 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" event={"ID":"8eac61bd-c080-44da-92c8-e22b19a7cc44","Type":"ContainerDied","Data":"f820a64f2ab2551475c7e2a0b489c1107a117bc76ee8736bf93e251d257f11db"} May 21 18:22:31.845185 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:31.845099 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" event={"ID":"8eac61bd-c080-44da-92c8-e22b19a7cc44","Type":"ContainerDied","Data":"9f29f16bdd3383d18812fb5effc1e35a413c79d9111f4a907a8c75a0240effd8"} May 21 18:22:32.850862 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:32.850826 2555 generic.go:358] "Generic (PLEG): container finished" podID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerID="6bebc64e6c345e82d044159b68d3e8b0ac23e36f607e03535ee0d6bca948cb8f" exitCode=0 May 21 18:22:32.851299 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:32.850905 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" event={"ID":"3e9f1004-e91c-47d1-a509-5ef0336a5c00","Type":"ContainerDied","Data":"6bebc64e6c345e82d044159b68d3e8b0ac23e36f607e03535ee0d6bca948cb8f"} May 21 18:22:32.852713 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:32.852692 2555 generic.go:358] "Generic (PLEG): container finished" podID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerID="9f50476edb73f6ce316476b6b02859d021177e13c41d8f0c1f2036ea50a3e3fd" exitCode=0 May 21 18:22:32.852804 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:32.852726 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" event={"ID":"8a67a799-b79e-467b-8fb2-0877392b2dc5","Type":"ContainerDied","Data":"9f50476edb73f6ce316476b6b02859d021177e13c41d8f0c1f2036ea50a3e3fd"} May 21 18:22:32.854537 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:32.854509 2555 generic.go:358] "Generic (PLEG): container finished" podID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerID="184041e55b0c0d25f9994040884e558bd0ed895372342ddd0c31fb09a364bc4c" exitCode=0 May 21 18:22:32.854632 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:32.854535 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" event={"ID":"60da7a16-3989-4e55-8131-01bab1f37b5c","Type":"ContainerDied","Data":"184041e55b0c0d25f9994040884e558bd0ed895372342ddd0c31fb09a364bc4c"} May 21 18:22:33.004744 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.004720 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:33.130947 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.130908 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-util\") pod \"8eac61bd-c080-44da-92c8-e22b19a7cc44\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " May 21 18:22:33.131097 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.130985 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp695\" (UniqueName: \"kubernetes.io/projected/8eac61bd-c080-44da-92c8-e22b19a7cc44-kube-api-access-zp695\") pod \"8eac61bd-c080-44da-92c8-e22b19a7cc44\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " May 21 18:22:33.131097 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.131026 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-bundle\") pod \"8eac61bd-c080-44da-92c8-e22b19a7cc44\" (UID: \"8eac61bd-c080-44da-92c8-e22b19a7cc44\") " May 21 18:22:33.131582 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.131554 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-bundle" (OuterVolumeSpecName: "bundle") pod "8eac61bd-c080-44da-92c8-e22b19a7cc44" (UID: "8eac61bd-c080-44da-92c8-e22b19a7cc44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:22:33.133403 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.133382 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eac61bd-c080-44da-92c8-e22b19a7cc44-kube-api-access-zp695" (OuterVolumeSpecName: "kube-api-access-zp695") pod "8eac61bd-c080-44da-92c8-e22b19a7cc44" (UID: "8eac61bd-c080-44da-92c8-e22b19a7cc44"). InnerVolumeSpecName "kube-api-access-zp695". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:22:33.136232 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.136205 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-util" (OuterVolumeSpecName: "util") pod "8eac61bd-c080-44da-92c8-e22b19a7cc44" (UID: "8eac61bd-c080-44da-92c8-e22b19a7cc44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:22:33.232327 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.232288 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:33.232327 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.232323 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp695\" (UniqueName: \"kubernetes.io/projected/8eac61bd-c080-44da-92c8-e22b19a7cc44-kube-api-access-zp695\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:33.232327 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.232336 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8eac61bd-c080-44da-92c8-e22b19a7cc44-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:33.861561 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.861524 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" May 21 18:22:33.861561 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.861547 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8" event={"ID":"8eac61bd-c080-44da-92c8-e22b19a7cc44","Type":"ContainerDied","Data":"1490f4aa42a825eca40cf66e080fa217a630e983ede4970a0390404f19dc07f5"} May 21 18:22:33.862224 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:33.861591 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1490f4aa42a825eca40cf66e080fa217a630e983ede4970a0390404f19dc07f5" May 21 18:22:34.000141 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.000097 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:34.063331 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.063302 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:34.066762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.066739 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:34.141841 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.141749 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxpv2\" (UniqueName: \"kubernetes.io/projected/8a67a799-b79e-467b-8fb2-0877392b2dc5-kube-api-access-cxpv2\") pod \"8a67a799-b79e-467b-8fb2-0877392b2dc5\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " May 21 18:22:34.142009 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.141867 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-util\") pod \"8a67a799-b79e-467b-8fb2-0877392b2dc5\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " May 21 18:22:34.142009 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.141907 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-bundle\") pod \"8a67a799-b79e-467b-8fb2-0877392b2dc5\" (UID: \"8a67a799-b79e-467b-8fb2-0877392b2dc5\") " May 21 18:22:34.142802 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.142772 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-bundle" (OuterVolumeSpecName: "bundle") pod "8a67a799-b79e-467b-8fb2-0877392b2dc5" (UID: "8a67a799-b79e-467b-8fb2-0877392b2dc5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:22:34.144525 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.144499 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a67a799-b79e-467b-8fb2-0877392b2dc5-kube-api-access-cxpv2" (OuterVolumeSpecName: "kube-api-access-cxpv2") pod "8a67a799-b79e-467b-8fb2-0877392b2dc5" (UID: "8a67a799-b79e-467b-8fb2-0877392b2dc5"). InnerVolumeSpecName "kube-api-access-cxpv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:22:34.147488 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.147465 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-util" (OuterVolumeSpecName: "util") pod "8a67a799-b79e-467b-8fb2-0877392b2dc5" (UID: "8a67a799-b79e-467b-8fb2-0877392b2dc5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:22:34.243378 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243327 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9n9p\" (UniqueName: \"kubernetes.io/projected/60da7a16-3989-4e55-8131-01bab1f37b5c-kube-api-access-v9n9p\") pod \"60da7a16-3989-4e55-8131-01bab1f37b5c\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " May 21 18:22:34.243378 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243382 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9z9x\" (UniqueName: \"kubernetes.io/projected/3e9f1004-e91c-47d1-a509-5ef0336a5c00-kube-api-access-d9z9x\") pod \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " May 21 18:22:34.243642 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243402 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-util\") pod \"60da7a16-3989-4e55-8131-01bab1f37b5c\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " May 21 18:22:34.243642 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243420 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-bundle\") pod \"60da7a16-3989-4e55-8131-01bab1f37b5c\" (UID: \"60da7a16-3989-4e55-8131-01bab1f37b5c\") " May 21 18:22:34.243642 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243471 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-bundle\") pod \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " May 21 18:22:34.243642 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243530 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-util\") pod \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\" (UID: \"3e9f1004-e91c-47d1-a509-5ef0336a5c00\") " May 21 18:22:34.243845 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243800 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxpv2\" (UniqueName: \"kubernetes.io/projected/8a67a799-b79e-467b-8fb2-0877392b2dc5-kube-api-access-cxpv2\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.243845 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243821 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.243845 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.243836 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a67a799-b79e-467b-8fb2-0877392b2dc5-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.244082 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.244042 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-bundle" (OuterVolumeSpecName: "bundle") pod "3e9f1004-e91c-47d1-a509-5ef0336a5c00" (UID: "3e9f1004-e91c-47d1-a509-5ef0336a5c00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:22:34.244232 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.244159 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-bundle" (OuterVolumeSpecName: "bundle") pod "60da7a16-3989-4e55-8131-01bab1f37b5c" (UID: "60da7a16-3989-4e55-8131-01bab1f37b5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:22:34.245649 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.245622 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60da7a16-3989-4e55-8131-01bab1f37b5c-kube-api-access-v9n9p" (OuterVolumeSpecName: "kube-api-access-v9n9p") pod "60da7a16-3989-4e55-8131-01bab1f37b5c" (UID: "60da7a16-3989-4e55-8131-01bab1f37b5c"). InnerVolumeSpecName "kube-api-access-v9n9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:22:34.245953 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.245929 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9f1004-e91c-47d1-a509-5ef0336a5c00-kube-api-access-d9z9x" (OuterVolumeSpecName: "kube-api-access-d9z9x") pod "3e9f1004-e91c-47d1-a509-5ef0336a5c00" (UID: "3e9f1004-e91c-47d1-a509-5ef0336a5c00"). InnerVolumeSpecName "kube-api-access-d9z9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:22:34.249646 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.249618 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-util" (OuterVolumeSpecName: "util") pod "60da7a16-3989-4e55-8131-01bab1f37b5c" (UID: "60da7a16-3989-4e55-8131-01bab1f37b5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:22:34.250250 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.250228 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-util" (OuterVolumeSpecName: "util") pod "3e9f1004-e91c-47d1-a509-5ef0336a5c00" (UID: "3e9f1004-e91c-47d1-a509-5ef0336a5c00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:22:34.344677 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.344634 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.344677 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.344671 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9n9p\" (UniqueName: \"kubernetes.io/projected/60da7a16-3989-4e55-8131-01bab1f37b5c-kube-api-access-v9n9p\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.344677 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.344684 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9z9x\" (UniqueName: \"kubernetes.io/projected/3e9f1004-e91c-47d1-a509-5ef0336a5c00-kube-api-access-d9z9x\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.344904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.344693 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-util\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.344904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.344702 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60da7a16-3989-4e55-8131-01bab1f37b5c-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.344904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.344711 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9f1004-e91c-47d1-a509-5ef0336a5c00-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:22:34.867301 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.867256 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" event={"ID":"3e9f1004-e91c-47d1-a509-5ef0336a5c00","Type":"ContainerDied","Data":"707e9ff78cfa617694d01c9a277f922b11eefc215a07f0f316107601dfeed4a8"} May 21 18:22:34.867301 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.867293 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="707e9ff78cfa617694d01c9a277f922b11eefc215a07f0f316107601dfeed4a8" May 21 18:22:34.867301 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.867297 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4" May 21 18:22:34.868952 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.868924 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" May 21 18:22:34.869091 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.868928 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n" event={"ID":"8a67a799-b79e-467b-8fb2-0877392b2dc5","Type":"ContainerDied","Data":"ba95c4ab184082306a1c9a6c0ba02b4e1ae53e96ba71a4137985b2a1f6fff6fc"} May 21 18:22:34.869091 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.869038 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba95c4ab184082306a1c9a6c0ba02b4e1ae53e96ba71a4137985b2a1f6fff6fc" May 21 18:22:34.870788 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.870767 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" May 21 18:22:34.870788 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.870779 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6" event={"ID":"60da7a16-3989-4e55-8131-01bab1f37b5c","Type":"ContainerDied","Data":"09a597b2a95fb98089715435c6a4f79cba749653ba8cd4c5e574a43e5e83ae36"} May 21 18:22:34.870934 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:34.870805 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09a597b2a95fb98089715435c6a4f79cba749653ba8cd4c5e574a43e5e83ae36" May 21 18:22:39.647844 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.647759 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd"] May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648084 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerName="pull" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648095 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerName="pull" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648118 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerName="extract" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648123 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerName="extract" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648130 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerName="extract" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648136 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerName="extract" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648148 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerName="extract" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648153 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerName="extract" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648165 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerName="util" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648170 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerName="util" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648176 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerName="util" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648181 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerName="util" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648188 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerName="util" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648194 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerName="util" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648199 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerName="pull" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648205 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerName="pull" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648212 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerName="util" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648217 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerName="util" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648223 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerName="pull" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648227 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerName="pull" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648233 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerName="pull" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648238 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerName="pull" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648245 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerName="extract" May 21 18:22:39.648240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648249 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerName="extract" May 21 18:22:39.648958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648305 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a67a799-b79e-467b-8fb2-0877392b2dc5" containerName="extract" May 21 18:22:39.648958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648313 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e9f1004-e91c-47d1-a509-5ef0336a5c00" containerName="extract" May 21 18:22:39.648958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648319 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eac61bd-c080-44da-92c8-e22b19a7cc44" containerName="extract" May 21 18:22:39.648958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.648326 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="60da7a16-3989-4e55-8131-01bab1f37b5c" containerName="extract" May 21 18:22:39.650372 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.650343 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:22:39.653025 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.653003 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-v9x5d\"" May 21 18:22:39.663958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.663929 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd"] May 21 18:22:39.685161 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.685098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pzzf\" (UniqueName: \"kubernetes.io/projected/03773b10-dbdb-415c-aa95-a4703da67c65-kube-api-access-6pzzf\") pod \"limitador-operator-controller-manager-85c4996f8c-bsswd\" (UID: \"03773b10-dbdb-415c-aa95-a4703da67c65\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:22:39.785933 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.785882 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzzf\" (UniqueName: \"kubernetes.io/projected/03773b10-dbdb-415c-aa95-a4703da67c65-kube-api-access-6pzzf\") pod \"limitador-operator-controller-manager-85c4996f8c-bsswd\" (UID: \"03773b10-dbdb-415c-aa95-a4703da67c65\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:22:39.801958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.801922 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pzzf\" (UniqueName: \"kubernetes.io/projected/03773b10-dbdb-415c-aa95-a4703da67c65-kube-api-access-6pzzf\") pod \"limitador-operator-controller-manager-85c4996f8c-bsswd\" (UID: \"03773b10-dbdb-415c-aa95-a4703da67c65\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:22:39.960352 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:39.960264 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:22:40.162899 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:40.162865 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd"] May 21 18:22:40.164355 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:40.164302 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03773b10_dbdb_415c_aa95_a4703da67c65.slice/crio-439831cfe67e67fe5b9a05173c84873f9d263d5d2117c58059cc67a490e1d318 WatchSource:0}: Error finding container 439831cfe67e67fe5b9a05173c84873f9d263d5d2117c58059cc67a490e1d318: Status 404 returned error can't find the container with id 439831cfe67e67fe5b9a05173c84873f9d263d5d2117c58059cc67a490e1d318 May 21 18:22:40.899753 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:40.899691 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" event={"ID":"03773b10-dbdb-415c-aa95-a4703da67c65","Type":"ContainerStarted","Data":"439831cfe67e67fe5b9a05173c84873f9d263d5d2117c58059cc67a490e1d318"} May 21 18:22:41.713279 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.713240 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-ff696fd8b-c8b2d"] May 21 18:22:41.716520 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.716486 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.739171 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.739135 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff696fd8b-c8b2d"] May 21 18:22:41.800208 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.800173 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-oauth-serving-cert\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.800451 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.800276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-oauth-config\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.800451 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.800304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-config\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.800451 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.800323 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8ghb\" (UniqueName: \"kubernetes.io/projected/22b6f5fb-b519-45f1-98df-c8d6c51a2762-kube-api-access-j8ghb\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.800451 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.800346 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-service-ca\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.800451 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.800378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-serving-cert\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.800451 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.800404 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-trusted-ca-bundle\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.901241 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.901201 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-oauth-config\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.901241 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.901242 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-config\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.901780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.901268 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8ghb\" (UniqueName: \"kubernetes.io/projected/22b6f5fb-b519-45f1-98df-c8d6c51a2762-kube-api-access-j8ghb\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.901780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.901499 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-service-ca\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.901780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.901571 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-serving-cert\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.901780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.901597 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-trusted-ca-bundle\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.901780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.901687 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-oauth-serving-cert\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.902169 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.902142 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-config\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.902320 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.902203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-service-ca\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.902454 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.902431 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-oauth-serving-cert\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.902693 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.902669 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f5fb-b519-45f1-98df-c8d6c51a2762-trusted-ca-bundle\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.904461 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.904435 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-oauth-config\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.904964 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.904942 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22b6f5fb-b519-45f1-98df-c8d6c51a2762-console-serving-cert\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:41.923574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:41.923545 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8ghb\" (UniqueName: \"kubernetes.io/projected/22b6f5fb-b519-45f1-98df-c8d6c51a2762-kube-api-access-j8ghb\") pod \"console-ff696fd8b-c8b2d\" (UID: \"22b6f5fb-b519-45f1-98df-c8d6c51a2762\") " pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:42.028950 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:42.028911 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:42.172586 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:42.172559 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff696fd8b-c8b2d"] May 21 18:22:42.175250 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:42.175224 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b6f5fb_b519_45f1_98df_c8d6c51a2762.slice/crio-592d391203540a4d13c62bbc9526fa0836c23fc79979ff1b7b0a17d078247e83 WatchSource:0}: Error finding container 592d391203540a4d13c62bbc9526fa0836c23fc79979ff1b7b0a17d078247e83: Status 404 returned error can't find the container with id 592d391203540a4d13c62bbc9526fa0836c23fc79979ff1b7b0a17d078247e83 May 21 18:22:42.912023 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:42.911981 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff696fd8b-c8b2d" event={"ID":"22b6f5fb-b519-45f1-98df-c8d6c51a2762","Type":"ContainerStarted","Data":"7dce4763baf3ef3ccdc8045471ec030df6634305843246724cab836e5e2ca036"} May 21 18:22:42.912023 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:42.912031 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff696fd8b-c8b2d" event={"ID":"22b6f5fb-b519-45f1-98df-c8d6c51a2762","Type":"ContainerStarted","Data":"592d391203540a4d13c62bbc9526fa0836c23fc79979ff1b7b0a17d078247e83"} May 21 18:22:42.913949 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:42.913913 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" event={"ID":"03773b10-dbdb-415c-aa95-a4703da67c65","Type":"ContainerStarted","Data":"8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb"} May 21 18:22:42.914101 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:42.914039 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:22:43.009701 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:43.009644 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-ff696fd8b-c8b2d" podStartSLOduration=2.009627167 podStartE2EDuration="2.009627167s" podCreationTimestamp="2026-05-21 18:22:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:22:42.966981226 +0000 UTC m=+532.531072488" watchObservedRunningTime="2026-05-21 18:22:43.009627167 +0000 UTC m=+532.573718429" May 21 18:22:43.012541 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:43.012489 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" podStartSLOduration=2.189999365 podStartE2EDuration="4.012475348s" podCreationTimestamp="2026-05-21 18:22:39 +0000 UTC" firstStartedPulling="2026-05-21 18:22:40.166763939 +0000 UTC m=+529.730855178" lastFinishedPulling="2026-05-21 18:22:41.989239923 +0000 UTC m=+531.553331161" observedRunningTime="2026-05-21 18:22:43.009603459 +0000 UTC m=+532.573694720" watchObservedRunningTime="2026-05-21 18:22:43.012475348 +0000 UTC m=+532.576566609" May 21 18:22:49.287083 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.287043 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l"] May 21 18:22:49.295742 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.295709 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" May 21 18:22:49.312080 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.312053 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-czr4r\"" May 21 18:22:49.318144 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.318086 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 18:22:49.320328 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.320302 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l"] May 21 18:22:49.365942 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.365903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxm7g\" (UniqueName: \"kubernetes.io/projected/ebb7240f-5572-4a5a-843b-7f0cbee53d80-kube-api-access-mxm7g\") pod \"dns-operator-controller-manager-648d5c98bc-fsk4l\" (UID: \"ebb7240f-5572-4a5a-843b-7f0cbee53d80\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" May 21 18:22:49.467229 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.467192 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxm7g\" (UniqueName: \"kubernetes.io/projected/ebb7240f-5572-4a5a-843b-7f0cbee53d80-kube-api-access-mxm7g\") pod \"dns-operator-controller-manager-648d5c98bc-fsk4l\" (UID: \"ebb7240f-5572-4a5a-843b-7f0cbee53d80\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" May 21 18:22:49.488676 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.488649 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxm7g\" (UniqueName: \"kubernetes.io/projected/ebb7240f-5572-4a5a-843b-7f0cbee53d80-kube-api-access-mxm7g\") pod \"dns-operator-controller-manager-648d5c98bc-fsk4l\" (UID: \"ebb7240f-5572-4a5a-843b-7f0cbee53d80\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" May 21 18:22:49.606565 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.606469 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" May 21 18:22:49.758584 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.758559 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l"] May 21 18:22:49.760526 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:49.760490 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb7240f_5572_4a5a_843b_7f0cbee53d80.slice/crio-62f7d7dd5a2fae941ae6658522e9df779d29f7b49067200fe68c59386dbed4d7 WatchSource:0}: Error finding container 62f7d7dd5a2fae941ae6658522e9df779d29f7b49067200fe68c59386dbed4d7: Status 404 returned error can't find the container with id 62f7d7dd5a2fae941ae6658522e9df779d29f7b49067200fe68c59386dbed4d7 May 21 18:22:49.944240 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:49.944154 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" event={"ID":"ebb7240f-5572-4a5a-843b-7f0cbee53d80","Type":"ContainerStarted","Data":"62f7d7dd5a2fae941ae6658522e9df779d29f7b49067200fe68c59386dbed4d7"} May 21 18:22:51.813999 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:51.813973 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 18:22:51.962046 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:51.962009 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" event={"ID":"ebb7240f-5572-4a5a-843b-7f0cbee53d80","Type":"ContainerStarted","Data":"2091ac28a6992bf9b0b0fd2c691c0ad848f07b1245e5a29a972f96241e2614d6"} May 21 18:22:51.962262 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:51.962136 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" May 21 18:22:51.999529 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:51.999476 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" podStartSLOduration=0.954662334 podStartE2EDuration="2.999460315s" podCreationTimestamp="2026-05-21 18:22:49 +0000 UTC" firstStartedPulling="2026-05-21 18:22:49.762532045 +0000 UTC m=+539.326623284" lastFinishedPulling="2026-05-21 18:22:51.807330025 +0000 UTC m=+541.371421265" observedRunningTime="2026-05-21 18:22:51.997125724 +0000 UTC m=+541.561216984" watchObservedRunningTime="2026-05-21 18:22:51.999460315 +0000 UTC m=+541.563551575" May 21 18:22:52.029399 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:52.029361 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:52.029574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:52.029462 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:52.034367 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:52.034343 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:52.970131 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:52.970090 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ff696fd8b-c8b2d" May 21 18:22:53.157459 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:53.157418 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95b75d849-djfsl"] May 21 18:22:53.921269 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:53.921234 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:22:54.652788 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.652748 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql"] May 21 18:22:54.656418 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.656399 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.661083 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.661036 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 18:22:54.661083 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.661077 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hh95b\"" May 21 18:22:54.661288 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.661163 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 18:22:54.675244 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.675210 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql"] May 21 18:22:54.713310 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.713278 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzl4\" (UniqueName: \"kubernetes.io/projected/687f078b-cc03-44f0-a291-562c24e98c54-kube-api-access-tfzl4\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.713488 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.713347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/687f078b-cc03-44f0-a291-562c24e98c54-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.713488 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.713404 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/687f078b-cc03-44f0-a291-562c24e98c54-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.814270 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.814233 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/687f078b-cc03-44f0-a291-562c24e98c54-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.814453 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.814309 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzl4\" (UniqueName: \"kubernetes.io/projected/687f078b-cc03-44f0-a291-562c24e98c54-kube-api-access-tfzl4\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.814453 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.814367 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/687f078b-cc03-44f0-a291-562c24e98c54-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.815058 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.815040 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/687f078b-cc03-44f0-a291-562c24e98c54-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.816861 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.816838 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/687f078b-cc03-44f0-a291-562c24e98c54-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.826144 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.826100 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzl4\" (UniqueName: \"kubernetes.io/projected/687f078b-cc03-44f0-a291-562c24e98c54-kube-api-access-tfzl4\") pod \"kuadrant-console-plugin-6cb54b5c86-h7sql\" (UID: \"687f078b-cc03-44f0-a291-562c24e98c54\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:54.965793 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:54.965691 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" May 21 18:22:55.129286 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:55.129259 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql"] May 21 18:22:55.130227 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:22:55.130196 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod687f078b_cc03_44f0_a291_562c24e98c54.slice/crio-1b605aa545a233570ce2cdd413020af17ac67722adc774fe3fb71519fb1b51f9 WatchSource:0}: Error finding container 1b605aa545a233570ce2cdd413020af17ac67722adc774fe3fb71519fb1b51f9: Status 404 returned error can't find the container with id 1b605aa545a233570ce2cdd413020af17ac67722adc774fe3fb71519fb1b51f9 May 21 18:22:55.980189 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:22:55.980155 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" event={"ID":"687f078b-cc03-44f0-a291-562c24e98c54","Type":"ContainerStarted","Data":"1b605aa545a233570ce2cdd413020af17ac67722adc774fe3fb71519fb1b51f9"} May 21 18:23:02.968755 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:02.968713 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fsk4l" May 21 18:23:04.942199 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:04.942161 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd"] May 21 18:23:04.942773 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:04.942487 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" containerName="manager" containerID="cri-o://8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb" gracePeriod=2 May 21 18:23:04.945077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:04.945051 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd"] May 21 18:23:04.945314 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:04.945284 2555 status_manager.go:895] "Failed to get status for pod" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" err="pods \"limitador-operator-controller-manager-85c4996f8c-bsswd\" is forbidden: User \"system:node:ip-10-0-138-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-244.ec2.internal' and this object" May 21 18:23:05.007148 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.007098 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn"] May 21 18:23:05.007613 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.007590 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" containerName="manager" May 21 18:23:05.007733 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.007642 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" containerName="manager" May 21 18:23:05.007804 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.007787 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" containerName="manager" May 21 18:23:05.027865 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.027832 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:05.045095 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.045065 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k6dnk\"" May 21 18:23:05.113372 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.113331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1557ba36-9745-4bb6-bef5-5aab471b8759-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lrhsn\" (UID: \"1557ba36-9745-4bb6-bef5-5aab471b8759\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:05.113548 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.113416 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc6w9\" (UniqueName: \"kubernetes.io/projected/1557ba36-9745-4bb6-bef5-5aab471b8759-kube-api-access-dc6w9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lrhsn\" (UID: \"1557ba36-9745-4bb6-bef5-5aab471b8759\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:05.138796 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.138762 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn"] May 21 18:23:05.204637 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.204536 2555 status_manager.go:895] "Failed to get status for pod" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" err="pods \"limitador-operator-controller-manager-85c4996f8c-bsswd\" is forbidden: User \"system:node:ip-10-0-138-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-244.ec2.internal' and this object" May 21 18:23:05.213876 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.213835 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc6w9\" (UniqueName: \"kubernetes.io/projected/1557ba36-9745-4bb6-bef5-5aab471b8759-kube-api-access-dc6w9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lrhsn\" (UID: \"1557ba36-9745-4bb6-bef5-5aab471b8759\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:05.214070 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.213930 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1557ba36-9745-4bb6-bef5-5aab471b8759-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lrhsn\" (UID: \"1557ba36-9745-4bb6-bef5-5aab471b8759\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:05.214299 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.214276 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1557ba36-9745-4bb6-bef5-5aab471b8759-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lrhsn\" (UID: \"1557ba36-9745-4bb6-bef5-5aab471b8759\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:05.252998 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.252968 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc6w9\" (UniqueName: \"kubernetes.io/projected/1557ba36-9745-4bb6-bef5-5aab471b8759-kube-api-access-dc6w9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lrhsn\" (UID: \"1557ba36-9745-4bb6-bef5-5aab471b8759\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:05.344811 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:05.344768 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:09.160921 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.160880 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5"] May 21 18:23:09.213223 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.213187 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5"] May 21 18:23:09.213389 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.213353 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:09.358238 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.358192 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cd87199-306d-4254-a035-9d99be351b9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fnrc5\" (UID: \"9cd87199-306d-4254-a035-9d99be351b9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:09.358238 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.358237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmn69\" (UniqueName: \"kubernetes.io/projected/9cd87199-306d-4254-a035-9d99be351b9b-kube-api-access-rmn69\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fnrc5\" (UID: \"9cd87199-306d-4254-a035-9d99be351b9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:09.459738 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.459651 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cd87199-306d-4254-a035-9d99be351b9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fnrc5\" (UID: \"9cd87199-306d-4254-a035-9d99be351b9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:09.459738 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.459700 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmn69\" (UniqueName: \"kubernetes.io/projected/9cd87199-306d-4254-a035-9d99be351b9b-kube-api-access-rmn69\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fnrc5\" (UID: \"9cd87199-306d-4254-a035-9d99be351b9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:09.460062 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.460037 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cd87199-306d-4254-a035-9d99be351b9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fnrc5\" (UID: \"9cd87199-306d-4254-a035-9d99be351b9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:09.477953 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.477920 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmn69\" (UniqueName: \"kubernetes.io/projected/9cd87199-306d-4254-a035-9d99be351b9b-kube-api-access-rmn69\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fnrc5\" (UID: \"9cd87199-306d-4254-a035-9d99be351b9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:09.526964 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:09.526921 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:18.176227 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.176185 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-95b75d849-djfsl" podUID="c8c5164c-a0e2-4506-bc66-7facd29b55d9" containerName="console" containerID="cri-o://cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e" gracePeriod=15 May 21 18:23:18.759644 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.759441 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-95b75d849-djfsl_c8c5164c-a0e2-4506-bc66-7facd29b55d9/console/0.log" May 21 18:23:18.759644 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.759503 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95b75d849-djfsl" May 21 18:23:18.807370 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.807340 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:23:18.809648 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.809617 2555 status_manager.go:895] "Failed to get status for pod" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" err="pods \"limitador-operator-controller-manager-85c4996f8c-bsswd\" is forbidden: User \"system:node:ip-10-0-138-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-244.ec2.internal' and this object" May 21 18:23:18.835837 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.833368 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5"] May 21 18:23:18.836635 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:23:18.836596 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd87199_306d_4254_a035_9d99be351b9b.slice/crio-d0c64f0fed040262eda700363d8d2187bb8286ee91798e117039b2aa299d8ad4 WatchSource:0}: Error finding container d0c64f0fed040262eda700363d8d2187bb8286ee91798e117039b2aa299d8ad4: Status 404 returned error can't find the container with id d0c64f0fed040262eda700363d8d2187bb8286ee91798e117039b2aa299d8ad4 May 21 18:23:18.851957 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.851902 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-oauth-serving-cert\") pod \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " May 21 18:23:18.851957 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.851944 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6p29\" (UniqueName: \"kubernetes.io/projected/c8c5164c-a0e2-4506-bc66-7facd29b55d9-kube-api-access-r6p29\") pod \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " May 21 18:23:18.852089 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.851980 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-oauth-config\") pod \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " May 21 18:23:18.852164 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852091 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-service-ca\") pod \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " May 21 18:23:18.852224 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852190 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-serving-cert\") pod \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " May 21 18:23:18.852278 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852224 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-trusted-ca-bundle\") pod \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " May 21 18:23:18.852328 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852278 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-config\") pod \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\" (UID: \"c8c5164c-a0e2-4506-bc66-7facd29b55d9\") " May 21 18:23:18.852375 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852314 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c8c5164c-a0e2-4506-bc66-7facd29b55d9" (UID: "c8c5164c-a0e2-4506-bc66-7facd29b55d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:23:18.852591 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852542 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "c8c5164c-a0e2-4506-bc66-7facd29b55d9" (UID: "c8c5164c-a0e2-4506-bc66-7facd29b55d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:23:18.852591 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852546 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-oauth-serving-cert\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:18.852728 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852625 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c8c5164c-a0e2-4506-bc66-7facd29b55d9" (UID: "c8c5164c-a0e2-4506-bc66-7facd29b55d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:23:18.852823 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.852797 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-config" (OuterVolumeSpecName: "console-config") pod "c8c5164c-a0e2-4506-bc66-7facd29b55d9" (UID: "c8c5164c-a0e2-4506-bc66-7facd29b55d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:23:18.854401 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.854368 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c8c5164c-a0e2-4506-bc66-7facd29b55d9" (UID: "c8c5164c-a0e2-4506-bc66-7facd29b55d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:23:18.854508 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.854403 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8c5164c-a0e2-4506-bc66-7facd29b55d9-kube-api-access-r6p29" (OuterVolumeSpecName: "kube-api-access-r6p29") pod "c8c5164c-a0e2-4506-bc66-7facd29b55d9" (UID: "c8c5164c-a0e2-4506-bc66-7facd29b55d9"). InnerVolumeSpecName "kube-api-access-r6p29". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:23:18.854508 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.854455 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c8c5164c-a0e2-4506-bc66-7facd29b55d9" (UID: "c8c5164c-a0e2-4506-bc66-7facd29b55d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:23:18.865680 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.865658 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn"] May 21 18:23:18.867680 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:23:18.867655 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1557ba36_9745_4bb6_bef5_5aab471b8759.slice/crio-dda152147248d116a26211335bf9a6aefd1976595fcb5ba07bc8c48e5dd23e32 WatchSource:0}: Error finding container dda152147248d116a26211335bf9a6aefd1976595fcb5ba07bc8c48e5dd23e32: Status 404 returned error can't find the container with id dda152147248d116a26211335bf9a6aefd1976595fcb5ba07bc8c48e5dd23e32 May 21 18:23:18.953893 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.953848 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pzzf\" (UniqueName: \"kubernetes.io/projected/03773b10-dbdb-415c-aa95-a4703da67c65-kube-api-access-6pzzf\") pod \"03773b10-dbdb-415c-aa95-a4703da67c65\" (UID: \"03773b10-dbdb-415c-aa95-a4703da67c65\") " May 21 18:23:18.954186 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.954168 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-config\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:18.954275 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.954190 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6p29\" (UniqueName: \"kubernetes.io/projected/c8c5164c-a0e2-4506-bc66-7facd29b55d9-kube-api-access-r6p29\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:18.954275 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.954204 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-oauth-config\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:18.954275 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.954217 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-service-ca\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:18.954275 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.954231 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8c5164c-a0e2-4506-bc66-7facd29b55d9-console-serving-cert\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:18.954275 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.954248 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8c5164c-a0e2-4506-bc66-7facd29b55d9-trusted-ca-bundle\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:18.955928 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:18.955903 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03773b10-dbdb-415c-aa95-a4703da67c65-kube-api-access-6pzzf" (OuterVolumeSpecName: "kube-api-access-6pzzf") pod "03773b10-dbdb-415c-aa95-a4703da67c65" (UID: "03773b10-dbdb-415c-aa95-a4703da67c65"). InnerVolumeSpecName "kube-api-access-6pzzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:23:19.021558 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.021526 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" path="/var/lib/kubelet/pods/03773b10-dbdb-415c-aa95-a4703da67c65/volumes" May 21 18:23:19.055725 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.055697 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pzzf\" (UniqueName: \"kubernetes.io/projected/03773b10-dbdb-415c-aa95-a4703da67c65-kube-api-access-6pzzf\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:19.084209 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.084170 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" event={"ID":"687f078b-cc03-44f0-a291-562c24e98c54","Type":"ContainerStarted","Data":"ae746b52bad59136584573b2984e377717a1106adac0fc7aff5f2099a4cd74d2"} May 21 18:23:19.085378 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.085348 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" event={"ID":"1557ba36-9745-4bb6-bef5-5aab471b8759","Type":"ContainerStarted","Data":"dda152147248d116a26211335bf9a6aefd1976595fcb5ba07bc8c48e5dd23e32"} May 21 18:23:19.086457 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.086438 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-95b75d849-djfsl_c8c5164c-a0e2-4506-bc66-7facd29b55d9/console/0.log" May 21 18:23:19.086559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.086476 2555 generic.go:358] "Generic (PLEG): container finished" podID="c8c5164c-a0e2-4506-bc66-7facd29b55d9" containerID="cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e" exitCode=2 May 21 18:23:19.086559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.086535 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95b75d849-djfsl" May 21 18:23:19.086678 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.086554 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95b75d849-djfsl" event={"ID":"c8c5164c-a0e2-4506-bc66-7facd29b55d9","Type":"ContainerDied","Data":"cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e"} May 21 18:23:19.086678 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.086584 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95b75d849-djfsl" event={"ID":"c8c5164c-a0e2-4506-bc66-7facd29b55d9","Type":"ContainerDied","Data":"3a08e8ffbf4fb6e72b1118d2ec255b9b3e5f5fcccf59c38dfba7d8f9b3b41621"} May 21 18:23:19.086678 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.086603 2555 scope.go:117] "RemoveContainer" containerID="cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e" May 21 18:23:19.087948 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.087925 2555 generic.go:358] "Generic (PLEG): container finished" podID="03773b10-dbdb-415c-aa95-a4703da67c65" containerID="8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb" exitCode=0 May 21 18:23:19.088051 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.087973 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" May 21 18:23:19.089452 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.089431 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" event={"ID":"9cd87199-306d-4254-a035-9d99be351b9b","Type":"ContainerStarted","Data":"d0c64f0fed040262eda700363d8d2187bb8286ee91798e117039b2aa299d8ad4"} May 21 18:23:19.096299 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.096269 2555 scope.go:117] "RemoveContainer" containerID="cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e" May 21 18:23:19.096548 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:23:19.096530 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e\": container with ID starting with cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e not found: ID does not exist" containerID="cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e" May 21 18:23:19.096596 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.096560 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e"} err="failed to get container status \"cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e\": rpc error: code = NotFound desc = could not find container \"cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e\": container with ID starting with cb23a85729b848e3e8e24416206bae714383897522069254a4fb3a985dfc317e not found: ID does not exist" May 21 18:23:19.096596 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.096580 2555 scope.go:117] "RemoveContainer" containerID="8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb" May 21 18:23:19.104485 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.104467 2555 scope.go:117] "RemoveContainer" containerID="8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb" May 21 18:23:19.104738 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:23:19.104720 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb\": container with ID starting with 8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb not found: ID does not exist" containerID="8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb" May 21 18:23:19.104797 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.104749 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb"} err="failed to get container status \"8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb\": rpc error: code = NotFound desc = could not find container \"8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb\": container with ID starting with 8f55bbf7a8f468d5e6d0a088314b54a43c9a6ddb10657ad4558e6fe543fe1bcb not found: ID does not exist" May 21 18:23:19.132504 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.132454 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-h7sql" podStartSLOduration=1.588406674 podStartE2EDuration="25.132438701s" podCreationTimestamp="2026-05-21 18:22:54 +0000 UTC" firstStartedPulling="2026-05-21 18:22:55.13200522 +0000 UTC m=+544.696096460" lastFinishedPulling="2026-05-21 18:23:18.67603723 +0000 UTC m=+568.240128487" observedRunningTime="2026-05-21 18:23:19.129841135 +0000 UTC m=+568.693932401" watchObservedRunningTime="2026-05-21 18:23:19.132438701 +0000 UTC m=+568.696529961" May 21 18:23:19.161644 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.161606 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95b75d849-djfsl"] May 21 18:23:19.169488 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.169453 2555 status_manager.go:895] "Failed to get status for pod" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" err="pods \"limitador-operator-controller-manager-85c4996f8c-bsswd\" is forbidden: User \"system:node:ip-10-0-138-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-244.ec2.internal' and this object" May 21 18:23:19.170737 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:19.170713 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-95b75d849-djfsl"] May 21 18:23:21.024018 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:21.023980 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8c5164c-a0e2-4506-bc66-7facd29b55d9" path="/var/lib/kubelet/pods/c8c5164c-a0e2-4506-bc66-7facd29b55d9/volumes" May 21 18:23:21.024712 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:21.024678 2555 status_manager.go:895] "Failed to get status for pod" podUID="03773b10-dbdb-415c-aa95-a4703da67c65" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bsswd" err="pods \"limitador-operator-controller-manager-85c4996f8c-bsswd\" is forbidden: User \"system:node:ip-10-0-138-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-244.ec2.internal' and this object" May 21 18:23:24.115967 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:24.115851 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" event={"ID":"9cd87199-306d-4254-a035-9d99be351b9b","Type":"ContainerStarted","Data":"a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75"} May 21 18:23:24.115967 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:24.115938 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:24.118302 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:24.118074 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" event={"ID":"1557ba36-9745-4bb6-bef5-5aab471b8759","Type":"ContainerStarted","Data":"c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11"} May 21 18:23:24.118794 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:24.118763 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:24.197679 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:24.197628 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" podStartSLOduration=15.501937827 podStartE2EDuration="20.19761352s" podCreationTimestamp="2026-05-21 18:23:04 +0000 UTC" firstStartedPulling="2026-05-21 18:23:18.869869399 +0000 UTC m=+568.433960638" lastFinishedPulling="2026-05-21 18:23:23.565545078 +0000 UTC m=+573.129636331" observedRunningTime="2026-05-21 18:23:24.194003424 +0000 UTC m=+573.758094686" watchObservedRunningTime="2026-05-21 18:23:24.19761352 +0000 UTC m=+573.761704780" May 21 18:23:24.198036 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:24.198014 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" podStartSLOduration=10.460074346 podStartE2EDuration="15.198008637s" podCreationTimestamp="2026-05-21 18:23:09 +0000 UTC" firstStartedPulling="2026-05-21 18:23:18.839351689 +0000 UTC m=+568.403442928" lastFinishedPulling="2026-05-21 18:23:23.577285979 +0000 UTC m=+573.141377219" observedRunningTime="2026-05-21 18:23:24.152674927 +0000 UTC m=+573.716766187" watchObservedRunningTime="2026-05-21 18:23:24.198008637 +0000 UTC m=+573.762099938" May 21 18:23:35.124562 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.124517 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:35.125037 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.124810 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:23:35.229911 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.229878 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn"] May 21 18:23:35.230117 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.230072 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" podUID="1557ba36-9745-4bb6-bef5-5aab471b8759" containerName="manager" containerID="cri-o://c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11" gracePeriod=10 May 21 18:23:35.474816 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.474784 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:35.505693 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.505656 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1557ba36-9745-4bb6-bef5-5aab471b8759-extensions-socket-volume\") pod \"1557ba36-9745-4bb6-bef5-5aab471b8759\" (UID: \"1557ba36-9745-4bb6-bef5-5aab471b8759\") " May 21 18:23:35.505806 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.505769 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc6w9\" (UniqueName: \"kubernetes.io/projected/1557ba36-9745-4bb6-bef5-5aab471b8759-kube-api-access-dc6w9\") pod \"1557ba36-9745-4bb6-bef5-5aab471b8759\" (UID: \"1557ba36-9745-4bb6-bef5-5aab471b8759\") " May 21 18:23:35.506388 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.506353 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1557ba36-9745-4bb6-bef5-5aab471b8759-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1557ba36-9745-4bb6-bef5-5aab471b8759" (UID: "1557ba36-9745-4bb6-bef5-5aab471b8759"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:23:35.508515 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.508471 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1557ba36-9745-4bb6-bef5-5aab471b8759-kube-api-access-dc6w9" (OuterVolumeSpecName: "kube-api-access-dc6w9") pod "1557ba36-9745-4bb6-bef5-5aab471b8759" (UID: "1557ba36-9745-4bb6-bef5-5aab471b8759"). InnerVolumeSpecName "kube-api-access-dc6w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:23:35.606777 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.606738 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc6w9\" (UniqueName: \"kubernetes.io/projected/1557ba36-9745-4bb6-bef5-5aab471b8759-kube-api-access-dc6w9\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:35.606777 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:35.606772 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1557ba36-9745-4bb6-bef5-5aab471b8759-extensions-socket-volume\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:23:36.165533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.165499 2555 generic.go:358] "Generic (PLEG): container finished" podID="1557ba36-9745-4bb6-bef5-5aab471b8759" containerID="c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11" exitCode=0 May 21 18:23:36.165533 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.165537 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" event={"ID":"1557ba36-9745-4bb6-bef5-5aab471b8759","Type":"ContainerDied","Data":"c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11"} May 21 18:23:36.166065 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.165558 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" event={"ID":"1557ba36-9745-4bb6-bef5-5aab471b8759","Type":"ContainerDied","Data":"dda152147248d116a26211335bf9a6aefd1976595fcb5ba07bc8c48e5dd23e32"} May 21 18:23:36.166065 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.165563 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn" May 21 18:23:36.166065 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.165573 2555 scope.go:117] "RemoveContainer" containerID="c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11" May 21 18:23:36.176163 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.176146 2555 scope.go:117] "RemoveContainer" containerID="c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11" May 21 18:23:36.176426 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:23:36.176410 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11\": container with ID starting with c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11 not found: ID does not exist" containerID="c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11" May 21 18:23:36.176465 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.176435 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11"} err="failed to get container status \"c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11\": rpc error: code = NotFound desc = could not find container \"c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11\": container with ID starting with c8c795320b243da9c6a34193b77ae07dbac186fb75d7707ac16ceecae97f8d11 not found: ID does not exist" May 21 18:23:36.194565 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.194534 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn"] May 21 18:23:36.202289 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:36.202258 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lrhsn"] May 21 18:23:37.021326 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:37.021293 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1557ba36-9745-4bb6-bef5-5aab471b8759" path="/var/lib/kubelet/pods/1557ba36-9745-4bb6-bef5-5aab471b8759/volumes" May 21 18:23:50.921770 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:50.921728 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:23:50.922914 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:50.922892 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:23:51.708025 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.707984 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn"] May 21 18:23:51.708411 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.708394 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8c5164c-a0e2-4506-bc66-7facd29b55d9" containerName="console" May 21 18:23:51.708411 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.708411 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8c5164c-a0e2-4506-bc66-7facd29b55d9" containerName="console" May 21 18:23:51.708570 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.708421 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1557ba36-9745-4bb6-bef5-5aab471b8759" containerName="manager" May 21 18:23:51.708570 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.708427 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1557ba36-9745-4bb6-bef5-5aab471b8759" containerName="manager" May 21 18:23:51.708570 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.708492 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="1557ba36-9745-4bb6-bef5-5aab471b8759" containerName="manager" May 21 18:23:51.708570 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.708503 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8c5164c-a0e2-4506-bc66-7facd29b55d9" containerName="console" May 21 18:23:51.810534 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.810494 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn"] May 21 18:23:51.810709 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.810628 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.815663 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.815642 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9cplg\"" May 21 18:23:51.957184 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c320db-771d-4480-8904-d9245337352d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.957574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.957574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957301 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.957574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.957574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957386 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.957574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957434 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c320db-771d-4480-8904-d9245337352d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.957574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vg7h\" (UniqueName: \"kubernetes.io/projected/d2c320db-771d-4480-8904-d9245337352d-kube-api-access-4vg7h\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.957574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c320db-771d-4480-8904-d9245337352d-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:51.957574 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:51.957562 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058316 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058274 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c320db-771d-4480-8904-d9245337352d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058517 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058339 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058517 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058369 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058517 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058393 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058517 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058418 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058517 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058453 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c320db-771d-4480-8904-d9245337352d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058517 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058476 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vg7h\" (UniqueName: \"kubernetes.io/projected/d2c320db-771d-4480-8904-d9245337352d-kube-api-access-4vg7h\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058517 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058496 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c320db-771d-4480-8904-d9245337352d-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058790 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058533 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058885 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058859 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.058951 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.058932 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.059073 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.059051 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.059174 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.059071 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.059518 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.059493 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c320db-771d-4480-8904-d9245337352d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.060836 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.060811 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c320db-771d-4480-8904-d9245337352d-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.061016 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.060994 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c320db-771d-4480-8904-d9245337352d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.071232 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.071201 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vg7h\" (UniqueName: \"kubernetes.io/projected/d2c320db-771d-4480-8904-d9245337352d-kube-api-access-4vg7h\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.071232 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.071222 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c320db-771d-4480-8904-d9245337352d-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kkdnn\" (UID: \"d2c320db-771d-4480-8904-d9245337352d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.121369 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.121334 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:52.268858 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.268829 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn"] May 21 18:23:52.270161 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:23:52.270130 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c320db_771d_4480_8904_d9245337352d.slice/crio-a49cd294a1e6391b54d594b22aca8e37fd70d18b794358337c71bbf078aeba9a WatchSource:0}: Error finding container a49cd294a1e6391b54d594b22aca8e37fd70d18b794358337c71bbf078aeba9a: Status 404 returned error can't find the container with id a49cd294a1e6391b54d594b22aca8e37fd70d18b794358337c71bbf078aeba9a May 21 18:23:52.272259 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.272223 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 18:23:52.272391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.272301 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 18:23:52.272391 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:52.272342 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 18:23:53.235347 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:53.235305 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" event={"ID":"d2c320db-771d-4480-8904-d9245337352d","Type":"ContainerStarted","Data":"93d1b1448a8d845f36a7f43cdec0e255188eb747c59f02c61f8e80aa29105be9"} May 21 18:23:53.235347 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:53.235351 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" event={"ID":"d2c320db-771d-4480-8904-d9245337352d","Type":"ContainerStarted","Data":"a49cd294a1e6391b54d594b22aca8e37fd70d18b794358337c71bbf078aeba9a"} May 21 18:23:53.267129 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:53.267029 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" podStartSLOduration=2.26701372 podStartE2EDuration="2.26701372s" podCreationTimestamp="2026-05-21 18:23:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:23:53.265176291 +0000 UTC m=+602.829267570" watchObservedRunningTime="2026-05-21 18:23:53.26701372 +0000 UTC m=+602.831105013" May 21 18:23:54.122410 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:54.122371 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:54.127216 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:54.127188 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:54.239177 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:54.239143 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:54.240121 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:54.240085 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kkdnn" May 21 18:23:56.487768 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.487730 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hxvb8"] May 21 18:23:56.491529 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.491511 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:23:56.494913 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.494886 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 18:23:56.501337 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.501317 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hxvb8"] May 21 18:23:56.572475 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.572440 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hxvb8"] May 21 18:23:56.602506 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.602475 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr8h8\" (UniqueName: \"kubernetes.io/projected/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-kube-api-access-tr8h8\") pod \"limitador-limitador-7d549b5b-hxvb8\" (UID: \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:23:56.602676 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.602558 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-config-file\") pod \"limitador-limitador-7d549b5b-hxvb8\" (UID: \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:23:56.703856 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.703817 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tr8h8\" (UniqueName: \"kubernetes.io/projected/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-kube-api-access-tr8h8\") pod \"limitador-limitador-7d549b5b-hxvb8\" (UID: \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:23:56.704016 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.703901 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-config-file\") pod \"limitador-limitador-7d549b5b-hxvb8\" (UID: \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:23:56.704518 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.704500 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-config-file\") pod \"limitador-limitador-7d549b5b-hxvb8\" (UID: \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:23:56.729340 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.729302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr8h8\" (UniqueName: \"kubernetes.io/projected/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-kube-api-access-tr8h8\") pod \"limitador-limitador-7d549b5b-hxvb8\" (UID: \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:23:56.803680 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.803592 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:23:56.961202 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:56.961173 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hxvb8"] May 21 18:23:56.963346 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:23:56.963314 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb2fb2e_0226_4b1f_b72a_2e4face3c155.slice/crio-66703cb9f01738ad33f6360ca26933877e9bb7062e258775740581188b0a54dd WatchSource:0}: Error finding container 66703cb9f01738ad33f6360ca26933877e9bb7062e258775740581188b0a54dd: Status 404 returned error can't find the container with id 66703cb9f01738ad33f6360ca26933877e9bb7062e258775740581188b0a54dd May 21 18:23:57.252020 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:23:57.251979 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" event={"ID":"9bb2fb2e-0226-4b1f-b72a-2e4face3c155","Type":"ContainerStarted","Data":"66703cb9f01738ad33f6360ca26933877e9bb7062e258775740581188b0a54dd"} May 21 18:24:00.264164 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:00.264130 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" event={"ID":"9bb2fb2e-0226-4b1f-b72a-2e4face3c155","Type":"ContainerStarted","Data":"8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2"} May 21 18:24:00.264557 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:00.264204 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:24:00.304719 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:00.304659 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" podStartSLOduration=1.44858347 podStartE2EDuration="4.304641302s" podCreationTimestamp="2026-05-21 18:23:56 +0000 UTC" firstStartedPulling="2026-05-21 18:23:56.965592975 +0000 UTC m=+606.529684215" lastFinishedPulling="2026-05-21 18:23:59.82165079 +0000 UTC m=+609.385742047" observedRunningTime="2026-05-21 18:24:00.302170624 +0000 UTC m=+609.866261885" watchObservedRunningTime="2026-05-21 18:24:00.304641302 +0000 UTC m=+609.868732599" May 21 18:24:11.269965 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:11.269879 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:24:12.077516 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.077475 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hxvb8"] May 21 18:24:12.077733 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.077704 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" podUID="9bb2fb2e-0226-4b1f-b72a-2e4face3c155" containerName="limitador" containerID="cri-o://8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2" gracePeriod=30 May 21 18:24:12.625436 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.625409 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:24:12.648259 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.648167 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-config-file\") pod \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\" (UID: \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\") " May 21 18:24:12.648259 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.648213 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr8h8\" (UniqueName: \"kubernetes.io/projected/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-kube-api-access-tr8h8\") pod \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\" (UID: \"9bb2fb2e-0226-4b1f-b72a-2e4face3c155\") " May 21 18:24:12.648534 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.648509 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-config-file" (OuterVolumeSpecName: "config-file") pod "9bb2fb2e-0226-4b1f-b72a-2e4face3c155" (UID: "9bb2fb2e-0226-4b1f-b72a-2e4face3c155"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:24:12.650377 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.650337 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-kube-api-access-tr8h8" (OuterVolumeSpecName: "kube-api-access-tr8h8") pod "9bb2fb2e-0226-4b1f-b72a-2e4face3c155" (UID: "9bb2fb2e-0226-4b1f-b72a-2e4face3c155"). InnerVolumeSpecName "kube-api-access-tr8h8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:24:12.748965 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.748916 2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-config-file\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:24:12.748965 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:12.748959 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr8h8\" (UniqueName: \"kubernetes.io/projected/9bb2fb2e-0226-4b1f-b72a-2e4face3c155-kube-api-access-tr8h8\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:24:13.319508 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.319419 2555 generic.go:358] "Generic (PLEG): container finished" podID="9bb2fb2e-0226-4b1f-b72a-2e4face3c155" containerID="8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2" exitCode=0 May 21 18:24:13.319508 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.319485 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" May 21 18:24:13.319689 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.319506 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" event={"ID":"9bb2fb2e-0226-4b1f-b72a-2e4face3c155","Type":"ContainerDied","Data":"8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2"} May 21 18:24:13.319689 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.319547 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-hxvb8" event={"ID":"9bb2fb2e-0226-4b1f-b72a-2e4face3c155","Type":"ContainerDied","Data":"66703cb9f01738ad33f6360ca26933877e9bb7062e258775740581188b0a54dd"} May 21 18:24:13.319689 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.319567 2555 scope.go:117] "RemoveContainer" containerID="8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2" May 21 18:24:13.328507 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.328487 2555 scope.go:117] "RemoveContainer" containerID="8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2" May 21 18:24:13.328810 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:24:13.328790 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2\": container with ID starting with 8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2 not found: ID does not exist" containerID="8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2" May 21 18:24:13.328869 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.328819 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2"} err="failed to get container status \"8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2\": rpc error: code = NotFound desc = could not find container \"8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2\": container with ID starting with 8c0d3c1ce8dbda85b29214ac1407fd3e4bb88a51f9cf989542d63acf89e07fa2 not found: ID does not exist" May 21 18:24:13.343171 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.343134 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hxvb8"] May 21 18:24:13.346063 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:13.346040 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hxvb8"] May 21 18:24:15.021869 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:15.021833 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bb2fb2e-0226-4b1f-b72a-2e4face3c155" path="/var/lib/kubelet/pods/9bb2fb2e-0226-4b1f-b72a-2e4face3c155/volumes" May 21 18:24:36.189851 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.189812 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df575f8c9-z6ssz"] May 21 18:24:36.190626 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.190402 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb2fb2e-0226-4b1f-b72a-2e4face3c155" containerName="limitador" May 21 18:24:36.190626 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.190421 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb2fb2e-0226-4b1f-b72a-2e4face3c155" containerName="limitador" May 21 18:24:36.190626 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.190514 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="9bb2fb2e-0226-4b1f-b72a-2e4face3c155" containerName="limitador" May 21 18:24:36.192976 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.192960 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:36.196839 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.196817 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5qzzn\"" May 21 18:24:36.196968 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.196864 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 18:24:36.220959 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.220928 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-z6ssz"] May 21 18:24:36.248482 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.248450 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78fgp\" (UniqueName: \"kubernetes.io/projected/eaead892-a34a-4829-8dbe-8645201dfa37-kube-api-access-78fgp\") pod \"maas-controller-7df575f8c9-z6ssz\" (UID: \"eaead892-a34a-4829-8dbe-8645201dfa37\") " pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:36.349543 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.349509 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78fgp\" (UniqueName: \"kubernetes.io/projected/eaead892-a34a-4829-8dbe-8645201dfa37-kube-api-access-78fgp\") pod \"maas-controller-7df575f8c9-z6ssz\" (UID: \"eaead892-a34a-4829-8dbe-8645201dfa37\") " pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:36.359529 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.359496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78fgp\" (UniqueName: \"kubernetes.io/projected/eaead892-a34a-4829-8dbe-8645201dfa37-kube-api-access-78fgp\") pod \"maas-controller-7df575f8c9-z6ssz\" (UID: \"eaead892-a34a-4829-8dbe-8645201dfa37\") " pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:36.405405 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.405366 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b5774677f-z4jwf"] May 21 18:24:36.407970 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.407949 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b5774677f-z4jwf" May 21 18:24:36.425463 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.425435 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b5774677f-z4jwf"] May 21 18:24:36.503580 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.503542 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:36.535302 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.535264 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b5774677f-z4jwf"] May 21 18:24:36.535581 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:24:36.535561 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cvp7n], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-7b5774677f-z4jwf" podUID="ba8922af-f56c-421c-992c-89a2b208a33f" May 21 18:24:36.552365 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.552001 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvp7n\" (UniqueName: \"kubernetes.io/projected/ba8922af-f56c-421c-992c-89a2b208a33f-kube-api-access-cvp7n\") pod \"maas-controller-7b5774677f-z4jwf\" (UID: \"ba8922af-f56c-421c-992c-89a2b208a33f\") " pod="opendatahub/maas-controller-7b5774677f-z4jwf" May 21 18:24:36.570274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.570240 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cb8f7f4b6-s628v"] May 21 18:24:36.573275 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.573252 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:24:36.585174 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.585142 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cb8f7f4b6-s628v"] May 21 18:24:36.648459 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.648433 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-z6ssz"] May 21 18:24:36.649546 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:24:36.649519 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaead892_a34a_4829_8dbe_8645201dfa37.slice/crio-d5fb039606ff2b14b43d09ca5ac1a3eb36acd1e0ca6ca87f9a4c083852939302 WatchSource:0}: Error finding container d5fb039606ff2b14b43d09ca5ac1a3eb36acd1e0ca6ca87f9a4c083852939302: Status 404 returned error can't find the container with id d5fb039606ff2b14b43d09ca5ac1a3eb36acd1e0ca6ca87f9a4c083852939302 May 21 18:24:36.651036 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.651021 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:24:36.652845 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.652819 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvp7n\" (UniqueName: \"kubernetes.io/projected/ba8922af-f56c-421c-992c-89a2b208a33f-kube-api-access-cvp7n\") pod \"maas-controller-7b5774677f-z4jwf\" (UID: \"ba8922af-f56c-421c-992c-89a2b208a33f\") " pod="opendatahub/maas-controller-7b5774677f-z4jwf" May 21 18:24:36.652936 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.652892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjzq9\" (UniqueName: \"kubernetes.io/projected/c8a1ea50-52c2-4450-adc5-f280f54e57d4-kube-api-access-xjzq9\") pod \"maas-controller-7cb8f7f4b6-s628v\" (UID: \"c8a1ea50-52c2-4450-adc5-f280f54e57d4\") " pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:24:36.661836 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.661811 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvp7n\" (UniqueName: \"kubernetes.io/projected/ba8922af-f56c-421c-992c-89a2b208a33f-kube-api-access-cvp7n\") pod \"maas-controller-7b5774677f-z4jwf\" (UID: \"ba8922af-f56c-421c-992c-89a2b208a33f\") " pod="opendatahub/maas-controller-7b5774677f-z4jwf" May 21 18:24:36.754310 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.754217 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjzq9\" (UniqueName: \"kubernetes.io/projected/c8a1ea50-52c2-4450-adc5-f280f54e57d4-kube-api-access-xjzq9\") pod \"maas-controller-7cb8f7f4b6-s628v\" (UID: \"c8a1ea50-52c2-4450-adc5-f280f54e57d4\") " pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:24:36.764958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.764929 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjzq9\" (UniqueName: \"kubernetes.io/projected/c8a1ea50-52c2-4450-adc5-f280f54e57d4-kube-api-access-xjzq9\") pod \"maas-controller-7cb8f7f4b6-s628v\" (UID: \"c8a1ea50-52c2-4450-adc5-f280f54e57d4\") " pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:24:36.885235 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:36.885185 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:24:37.024118 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:37.024081 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cb8f7f4b6-s628v"] May 21 18:24:37.025947 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:24:37.025919 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a1ea50_52c2_4450_adc5_f280f54e57d4.slice/crio-4c00e1c977527d46d33a8535d575476ddde1954e013ec5aefd78e43220a6e8d7 WatchSource:0}: Error finding container 4c00e1c977527d46d33a8535d575476ddde1954e013ec5aefd78e43220a6e8d7: Status 404 returned error can't find the container with id 4c00e1c977527d46d33a8535d575476ddde1954e013ec5aefd78e43220a6e8d7 May 21 18:24:37.425077 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:37.424909 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" event={"ID":"c8a1ea50-52c2-4450-adc5-f280f54e57d4","Type":"ContainerStarted","Data":"4c00e1c977527d46d33a8535d575476ddde1954e013ec5aefd78e43220a6e8d7"} May 21 18:24:37.426573 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:37.426541 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" event={"ID":"eaead892-a34a-4829-8dbe-8645201dfa37","Type":"ContainerStarted","Data":"d5fb039606ff2b14b43d09ca5ac1a3eb36acd1e0ca6ca87f9a4c083852939302"} May 21 18:24:37.426729 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:37.426581 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b5774677f-z4jwf" May 21 18:24:37.433648 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:37.433621 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b5774677f-z4jwf" May 21 18:24:37.562452 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:37.562412 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvp7n\" (UniqueName: \"kubernetes.io/projected/ba8922af-f56c-421c-992c-89a2b208a33f-kube-api-access-cvp7n\") pod \"ba8922af-f56c-421c-992c-89a2b208a33f\" (UID: \"ba8922af-f56c-421c-992c-89a2b208a33f\") " May 21 18:24:37.565622 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:37.565587 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba8922af-f56c-421c-992c-89a2b208a33f-kube-api-access-cvp7n" (OuterVolumeSpecName: "kube-api-access-cvp7n") pod "ba8922af-f56c-421c-992c-89a2b208a33f" (UID: "ba8922af-f56c-421c-992c-89a2b208a33f"). InnerVolumeSpecName "kube-api-access-cvp7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:24:37.663445 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:37.663407 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvp7n\" (UniqueName: \"kubernetes.io/projected/ba8922af-f56c-421c-992c-89a2b208a33f-kube-api-access-cvp7n\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:24:38.432849 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:38.432814 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b5774677f-z4jwf" May 21 18:24:38.492841 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:38.492801 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b5774677f-z4jwf"] May 21 18:24:38.497500 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:38.497452 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b5774677f-z4jwf"] May 21 18:24:39.030468 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:39.030427 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba8922af-f56c-421c-992c-89a2b208a33f" path="/var/lib/kubelet/pods/ba8922af-f56c-421c-992c-89a2b208a33f/volumes" May 21 18:24:40.444827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:40.444784 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" event={"ID":"eaead892-a34a-4829-8dbe-8645201dfa37","Type":"ContainerStarted","Data":"9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530"} May 21 18:24:40.445448 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:40.444910 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:40.446308 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:40.446284 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" event={"ID":"c8a1ea50-52c2-4450-adc5-f280f54e57d4","Type":"ContainerStarted","Data":"e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a"} May 21 18:24:40.446411 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:40.446393 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:24:40.477520 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:40.477470 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" podStartSLOduration=1.278949022 podStartE2EDuration="4.477457092s" podCreationTimestamp="2026-05-21 18:24:36 +0000 UTC" firstStartedPulling="2026-05-21 18:24:36.651188132 +0000 UTC m=+646.215279376" lastFinishedPulling="2026-05-21 18:24:39.849696207 +0000 UTC m=+649.413787446" observedRunningTime="2026-05-21 18:24:40.474790938 +0000 UTC m=+650.038882199" watchObservedRunningTime="2026-05-21 18:24:40.477457092 +0000 UTC m=+650.041548353" May 21 18:24:40.501898 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:40.501838 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" podStartSLOduration=1.674590536 podStartE2EDuration="4.501821502s" podCreationTimestamp="2026-05-21 18:24:36 +0000 UTC" firstStartedPulling="2026-05-21 18:24:37.027538535 +0000 UTC m=+646.591629775" lastFinishedPulling="2026-05-21 18:24:39.854769494 +0000 UTC m=+649.418860741" observedRunningTime="2026-05-21 18:24:40.501730108 +0000 UTC m=+650.065821369" watchObservedRunningTime="2026-05-21 18:24:40.501821502 +0000 UTC m=+650.065912803" May 21 18:24:51.456170 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.456063 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:24:51.456170 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.456139 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:51.541926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.541886 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-z6ssz"] May 21 18:24:51.542243 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.542196 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" podUID="eaead892-a34a-4829-8dbe-8645201dfa37" containerName="manager" containerID="cri-o://9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530" gracePeriod=30 May 21 18:24:51.745171 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.745138 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84d777b9cf-k7djs"] May 21 18:24:51.748987 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.748964 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:24:51.757811 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.757762 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84d777b9cf-k7djs"] May 21 18:24:51.804585 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.804561 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:51.895446 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.895407 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78fgp\" (UniqueName: \"kubernetes.io/projected/eaead892-a34a-4829-8dbe-8645201dfa37-kube-api-access-78fgp\") pod \"eaead892-a34a-4829-8dbe-8645201dfa37\" (UID: \"eaead892-a34a-4829-8dbe-8645201dfa37\") " May 21 18:24:51.895655 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.895609 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfflt\" (UniqueName: \"kubernetes.io/projected/f5952df4-5a74-4593-b69e-e3752c0bc4f6-kube-api-access-dfflt\") pod \"maas-controller-84d777b9cf-k7djs\" (UID: \"f5952df4-5a74-4593-b69e-e3752c0bc4f6\") " pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:24:51.897703 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.897664 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaead892-a34a-4829-8dbe-8645201dfa37-kube-api-access-78fgp" (OuterVolumeSpecName: "kube-api-access-78fgp") pod "eaead892-a34a-4829-8dbe-8645201dfa37" (UID: "eaead892-a34a-4829-8dbe-8645201dfa37"). InnerVolumeSpecName "kube-api-access-78fgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:24:51.996595 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.996560 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dfflt\" (UniqueName: \"kubernetes.io/projected/f5952df4-5a74-4593-b69e-e3752c0bc4f6-kube-api-access-dfflt\") pod \"maas-controller-84d777b9cf-k7djs\" (UID: \"f5952df4-5a74-4593-b69e-e3752c0bc4f6\") " pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:24:51.996773 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:51.996619 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78fgp\" (UniqueName: \"kubernetes.io/projected/eaead892-a34a-4829-8dbe-8645201dfa37-kube-api-access-78fgp\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:24:52.005437 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.005404 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfflt\" (UniqueName: \"kubernetes.io/projected/f5952df4-5a74-4593-b69e-e3752c0bc4f6-kube-api-access-dfflt\") pod \"maas-controller-84d777b9cf-k7djs\" (UID: \"f5952df4-5a74-4593-b69e-e3752c0bc4f6\") " pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:24:52.062217 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.062176 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:24:52.207023 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.206990 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84d777b9cf-k7djs"] May 21 18:24:52.208534 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:24:52.208497 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5952df4_5a74_4593_b69e_e3752c0bc4f6.slice/crio-9855231f004011ad607915c87d7b27387167d8206187dda10209f45337ad4868 WatchSource:0}: Error finding container 9855231f004011ad607915c87d7b27387167d8206187dda10209f45337ad4868: Status 404 returned error can't find the container with id 9855231f004011ad607915c87d7b27387167d8206187dda10209f45337ad4868 May 21 18:24:52.493673 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.493632 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d777b9cf-k7djs" event={"ID":"f5952df4-5a74-4593-b69e-e3752c0bc4f6","Type":"ContainerStarted","Data":"9855231f004011ad607915c87d7b27387167d8206187dda10209f45337ad4868"} May 21 18:24:52.494710 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.494685 2555 generic.go:358] "Generic (PLEG): container finished" podID="eaead892-a34a-4829-8dbe-8645201dfa37" containerID="9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530" exitCode=0 May 21 18:24:52.494827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.494748 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" May 21 18:24:52.494827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.494774 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" event={"ID":"eaead892-a34a-4829-8dbe-8645201dfa37","Type":"ContainerDied","Data":"9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530"} May 21 18:24:52.494827 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.494818 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-z6ssz" event={"ID":"eaead892-a34a-4829-8dbe-8645201dfa37","Type":"ContainerDied","Data":"d5fb039606ff2b14b43d09ca5ac1a3eb36acd1e0ca6ca87f9a4c083852939302"} May 21 18:24:52.494999 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.494837 2555 scope.go:117] "RemoveContainer" containerID="9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530" May 21 18:24:52.503891 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.503873 2555 scope.go:117] "RemoveContainer" containerID="9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530" May 21 18:24:52.504189 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:24:52.504166 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530\": container with ID starting with 9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530 not found: ID does not exist" containerID="9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530" May 21 18:24:52.504281 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.504200 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530"} err="failed to get container status \"9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530\": rpc error: code = NotFound desc = could not find container \"9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530\": container with ID starting with 9a68f360d96676e3c508bd27d8a12ceca57edeb73c573d2bc5543980edc5e530 not found: ID does not exist" May 21 18:24:52.518634 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.518592 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-z6ssz"] May 21 18:24:52.525558 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:52.525528 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-z6ssz"] May 21 18:24:53.021988 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:53.021959 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaead892-a34a-4829-8dbe-8645201dfa37" path="/var/lib/kubelet/pods/eaead892-a34a-4829-8dbe-8645201dfa37/volumes" May 21 18:24:53.500004 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:53.499968 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d777b9cf-k7djs" event={"ID":"f5952df4-5a74-4593-b69e-e3752c0bc4f6","Type":"ContainerStarted","Data":"57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6"} May 21 18:24:53.500457 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:53.500033 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:24:53.524381 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:24:53.524329 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-84d777b9cf-k7djs" podStartSLOduration=2.18064069 podStartE2EDuration="2.524312852s" podCreationTimestamp="2026-05-21 18:24:51 +0000 UTC" firstStartedPulling="2026-05-21 18:24:52.209922264 +0000 UTC m=+661.774013503" lastFinishedPulling="2026-05-21 18:24:52.553594425 +0000 UTC m=+662.117685665" observedRunningTime="2026-05-21 18:24:53.520058925 +0000 UTC m=+663.084150186" watchObservedRunningTime="2026-05-21 18:24:53.524312852 +0000 UTC m=+663.088404122" May 21 18:25:04.511576 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:04.511541 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:25:04.591809 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:04.591763 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cb8f7f4b6-s628v"] May 21 18:25:04.592088 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:04.592061 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" podUID="c8a1ea50-52c2-4450-adc5-f280f54e57d4" containerName="manager" containerID="cri-o://e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a" gracePeriod=30 May 21 18:25:04.844806 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:04.844780 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:25:05.016524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.016409 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjzq9\" (UniqueName: \"kubernetes.io/projected/c8a1ea50-52c2-4450-adc5-f280f54e57d4-kube-api-access-xjzq9\") pod \"c8a1ea50-52c2-4450-adc5-f280f54e57d4\" (UID: \"c8a1ea50-52c2-4450-adc5-f280f54e57d4\") " May 21 18:25:05.025832 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.025796 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a1ea50-52c2-4450-adc5-f280f54e57d4-kube-api-access-xjzq9" (OuterVolumeSpecName: "kube-api-access-xjzq9") pod "c8a1ea50-52c2-4450-adc5-f280f54e57d4" (UID: "c8a1ea50-52c2-4450-adc5-f280f54e57d4"). InnerVolumeSpecName "kube-api-access-xjzq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:25:05.117679 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.117635 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjzq9\" (UniqueName: \"kubernetes.io/projected/c8a1ea50-52c2-4450-adc5-f280f54e57d4-kube-api-access-xjzq9\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:25:05.550176 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.550136 2555 generic.go:358] "Generic (PLEG): container finished" podID="c8a1ea50-52c2-4450-adc5-f280f54e57d4" containerID="e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a" exitCode=0 May 21 18:25:05.550592 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.550210 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" May 21 18:25:05.550592 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.550221 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" event={"ID":"c8a1ea50-52c2-4450-adc5-f280f54e57d4","Type":"ContainerDied","Data":"e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a"} May 21 18:25:05.550592 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.550257 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb8f7f4b6-s628v" event={"ID":"c8a1ea50-52c2-4450-adc5-f280f54e57d4","Type":"ContainerDied","Data":"4c00e1c977527d46d33a8535d575476ddde1954e013ec5aefd78e43220a6e8d7"} May 21 18:25:05.550592 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.550276 2555 scope.go:117] "RemoveContainer" containerID="e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a" May 21 18:25:05.559097 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.559076 2555 scope.go:117] "RemoveContainer" containerID="e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a" May 21 18:25:05.559422 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:25:05.559397 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a\": container with ID starting with e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a not found: ID does not exist" containerID="e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a" May 21 18:25:05.559481 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.559433 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a"} err="failed to get container status \"e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a\": rpc error: code = NotFound desc = could not find container \"e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a\": container with ID starting with e51ea5763b457d52434f84b12ace1cbee5749c098a4e89afc01ad5aa29de139a not found: ID does not exist" May 21 18:25:05.578441 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.578406 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cb8f7f4b6-s628v"] May 21 18:25:05.589935 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:05.589903 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cb8f7f4b6-s628v"] May 21 18:25:07.027758 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:07.023265 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8a1ea50-52c2-4450-adc5-f280f54e57d4" path="/var/lib/kubelet/pods/c8a1ea50-52c2-4450-adc5-f280f54e57d4/volumes" May 21 18:25:09.993382 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:09.993344 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-866d866747-wp7sx"] May 21 18:25:09.993765 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:09.993722 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8a1ea50-52c2-4450-adc5-f280f54e57d4" containerName="manager" May 21 18:25:09.993765 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:09.993734 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8a1ea50-52c2-4450-adc5-f280f54e57d4" containerName="manager" May 21 18:25:09.993765 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:09.993749 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaead892-a34a-4829-8dbe-8645201dfa37" containerName="manager" May 21 18:25:09.993765 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:09.993754 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaead892-a34a-4829-8dbe-8645201dfa37" containerName="manager" May 21 18:25:09.993896 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:09.993810 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="eaead892-a34a-4829-8dbe-8645201dfa37" containerName="manager" May 21 18:25:09.993896 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:09.993821 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8a1ea50-52c2-4450-adc5-f280f54e57d4" containerName="manager" May 21 18:25:09.996780 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:09.996763 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:10.000150 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.000099 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 18:25:10.057085 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.057055 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44cc6c67-7d41-40a8-8659-ed0119c4f9da-maas-api-tls\") pod \"maas-api-866d866747-wp7sx\" (UID: \"44cc6c67-7d41-40a8-8659-ed0119c4f9da\") " pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:10.057085 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.057094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k68hd\" (UniqueName: \"kubernetes.io/projected/44cc6c67-7d41-40a8-8659-ed0119c4f9da-kube-api-access-k68hd\") pod \"maas-api-866d866747-wp7sx\" (UID: \"44cc6c67-7d41-40a8-8659-ed0119c4f9da\") " pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:10.059145 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.059099 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-866d866747-wp7sx"] May 21 18:25:10.158585 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.158547 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44cc6c67-7d41-40a8-8659-ed0119c4f9da-maas-api-tls\") pod \"maas-api-866d866747-wp7sx\" (UID: \"44cc6c67-7d41-40a8-8659-ed0119c4f9da\") " pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:10.158585 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.158591 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k68hd\" (UniqueName: \"kubernetes.io/projected/44cc6c67-7d41-40a8-8659-ed0119c4f9da-kube-api-access-k68hd\") pod \"maas-api-866d866747-wp7sx\" (UID: \"44cc6c67-7d41-40a8-8659-ed0119c4f9da\") " pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:10.160991 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.160972 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44cc6c67-7d41-40a8-8659-ed0119c4f9da-maas-api-tls\") pod \"maas-api-866d866747-wp7sx\" (UID: \"44cc6c67-7d41-40a8-8659-ed0119c4f9da\") " pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:10.175281 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.175245 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k68hd\" (UniqueName: \"kubernetes.io/projected/44cc6c67-7d41-40a8-8659-ed0119c4f9da-kube-api-access-k68hd\") pod \"maas-api-866d866747-wp7sx\" (UID: \"44cc6c67-7d41-40a8-8659-ed0119c4f9da\") " pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:10.307031 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.306942 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:10.468140 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.468091 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-866d866747-wp7sx"] May 21 18:25:10.471154 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:25:10.471094 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cc6c67_7d41_40a8_8659_ed0119c4f9da.slice/crio-fce6f66df1db538a6ff19143fd3bdebcfbe684e286d40e18edb9e259d3b4313b WatchSource:0}: Error finding container fce6f66df1db538a6ff19143fd3bdebcfbe684e286d40e18edb9e259d3b4313b: Status 404 returned error can't find the container with id fce6f66df1db538a6ff19143fd3bdebcfbe684e286d40e18edb9e259d3b4313b May 21 18:25:10.482698 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.482666 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-49nwd"] May 21 18:25:10.487448 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.487425 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" May 21 18:25:10.490497 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.490474 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cq85q\"" May 21 18:25:10.490639 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.490474 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 18:25:10.502536 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.502506 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-49nwd"] May 21 18:25:10.562637 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.562528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-794bd\" (UniqueName: \"kubernetes.io/projected/c7d9ed13-212e-4845-8977-8c50bc0b0683-kube-api-access-794bd\") pod \"payload-processing-58b6c8fdc7-49nwd\" (UID: \"c7d9ed13-212e-4845-8977-8c50bc0b0683\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" May 21 18:25:10.573512 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.573471 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-866d866747-wp7sx" event={"ID":"44cc6c67-7d41-40a8-8659-ed0119c4f9da","Type":"ContainerStarted","Data":"fce6f66df1db538a6ff19143fd3bdebcfbe684e286d40e18edb9e259d3b4313b"} May 21 18:25:10.663372 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.663333 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-794bd\" (UniqueName: \"kubernetes.io/projected/c7d9ed13-212e-4845-8977-8c50bc0b0683-kube-api-access-794bd\") pod \"payload-processing-58b6c8fdc7-49nwd\" (UID: \"c7d9ed13-212e-4845-8977-8c50bc0b0683\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" May 21 18:25:10.688615 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.688575 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-794bd\" (UniqueName: \"kubernetes.io/projected/c7d9ed13-212e-4845-8977-8c50bc0b0683-kube-api-access-794bd\") pod \"payload-processing-58b6c8fdc7-49nwd\" (UID: \"c7d9ed13-212e-4845-8977-8c50bc0b0683\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" May 21 18:25:10.798423 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.798386 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" May 21 18:25:10.954535 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:10.954504 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-49nwd"] May 21 18:25:10.955739 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:25:10.955715 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d9ed13_212e_4845_8977_8c50bc0b0683.slice/crio-2c985f8b571e72e7248d5525dfa8c65b4024f395a9565bc81a8f1ba7082e3e98 WatchSource:0}: Error finding container 2c985f8b571e72e7248d5525dfa8c65b4024f395a9565bc81a8f1ba7082e3e98: Status 404 returned error can't find the container with id 2c985f8b571e72e7248d5525dfa8c65b4024f395a9565bc81a8f1ba7082e3e98 May 21 18:25:11.580182 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:11.580144 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" event={"ID":"c7d9ed13-212e-4845-8977-8c50bc0b0683","Type":"ContainerStarted","Data":"2c985f8b571e72e7248d5525dfa8c65b4024f395a9565bc81a8f1ba7082e3e98"} May 21 18:25:12.587197 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:12.587101 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-866d866747-wp7sx" event={"ID":"44cc6c67-7d41-40a8-8659-ed0119c4f9da","Type":"ContainerStarted","Data":"29add1a9c73ec602c95b45c3714f4777cfea2deb495791ebcdc858f7e6cb492a"} May 21 18:25:12.587567 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:12.587289 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:12.633144 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:12.631553 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-866d866747-wp7sx" podStartSLOduration=1.826890868 podStartE2EDuration="3.631530564s" podCreationTimestamp="2026-05-21 18:25:09 +0000 UTC" firstStartedPulling="2026-05-21 18:25:10.472735864 +0000 UTC m=+680.036827103" lastFinishedPulling="2026-05-21 18:25:12.27737556 +0000 UTC m=+681.841466799" observedRunningTime="2026-05-21 18:25:12.628498164 +0000 UTC m=+682.192589426" watchObservedRunningTime="2026-05-21 18:25:12.631530564 +0000 UTC m=+682.195621826" May 21 18:25:14.597326 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:14.597287 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" event={"ID":"c7d9ed13-212e-4845-8977-8c50bc0b0683","Type":"ContainerStarted","Data":"fac02dc9aa7633eb10b148397e92bf416e4250a6693e4f171d39415c02ebe071"} May 21 18:25:14.597717 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:14.597343 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" May 21 18:25:14.616955 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:14.616902 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" podStartSLOduration=1.157750541 podStartE2EDuration="4.616886414s" podCreationTimestamp="2026-05-21 18:25:10 +0000 UTC" firstStartedPulling="2026-05-21 18:25:10.957524879 +0000 UTC m=+680.521616117" lastFinishedPulling="2026-05-21 18:25:14.416660752 +0000 UTC m=+683.980751990" observedRunningTime="2026-05-21 18:25:14.616054879 +0000 UTC m=+684.180146141" watchObservedRunningTime="2026-05-21 18:25:14.616886414 +0000 UTC m=+684.180977675" May 21 18:25:18.597402 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:18.597370 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-866d866747-wp7sx" May 21 18:25:24.113926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.113892 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw"] May 21 18:25:24.117691 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.117670 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.121014 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.120982 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 18:25:24.121014 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.121010 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 18:25:24.121230 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.121038 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 18:25:24.121230 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.120987 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z4gdk\"" May 21 18:25:24.129477 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.129451 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw"] May 21 18:25:24.196839 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.196792 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb31bb6b-7489-49df-9995-430d3747250f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.197076 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.196853 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.197076 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.196923 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.197076 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.197018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.197286 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.197079 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8xlm\" (UniqueName: \"kubernetes.io/projected/eb31bb6b-7489-49df-9995-430d3747250f-kube-api-access-z8xlm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.197286 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.197160 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298262 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298221 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8xlm\" (UniqueName: \"kubernetes.io/projected/eb31bb6b-7489-49df-9995-430d3747250f-kube-api-access-z8xlm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298262 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298269 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298310 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb31bb6b-7489-49df-9995-430d3747250f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298332 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298367 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298401 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298822 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298784 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298822 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298798 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.298918 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.298855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.300719 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.300698 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb31bb6b-7489-49df-9995-430d3747250f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.301006 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.300990 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb31bb6b-7489-49df-9995-430d3747250f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.307702 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.307675 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8xlm\" (UniqueName: \"kubernetes.io/projected/eb31bb6b-7489-49df-9995-430d3747250f-kube-api-access-z8xlm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw\" (UID: \"eb31bb6b-7489-49df-9995-430d3747250f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.429921 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.429824 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:24.632674 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.632642 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw"] May 21 18:25:24.634595 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:25:24.634559 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb31bb6b_7489_49df_9995_430d3747250f.slice/crio-686f46bbe4e30733a14089e4aa3b2d3fd6461a1301adba09cdc3cbe0a8c2d052 WatchSource:0}: Error finding container 686f46bbe4e30733a14089e4aa3b2d3fd6461a1301adba09cdc3cbe0a8c2d052: Status 404 returned error can't find the container with id 686f46bbe4e30733a14089e4aa3b2d3fd6461a1301adba09cdc3cbe0a8c2d052 May 21 18:25:24.640041 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.640013 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" event={"ID":"eb31bb6b-7489-49df-9995-430d3747250f","Type":"ContainerStarted","Data":"686f46bbe4e30733a14089e4aa3b2d3fd6461a1301adba09cdc3cbe0a8c2d052"} May 21 18:25:24.732177 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.732141 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8"] May 21 18:25:24.740677 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.740640 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.744158 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.744130 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 18:25:24.756233 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.756203 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8"] May 21 18:25:24.803274 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.803237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08986ec4-a575-4f7d-ba76-a278a5666a54-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.803730 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.803519 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.803958 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.803934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq687\" (UniqueName: \"kubernetes.io/projected/08986ec4-a575-4f7d-ba76-a278a5666a54-kube-api-access-tq687\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.804085 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.804064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.804187 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.804154 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.804253 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.804192 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905215 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905179 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905422 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905229 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905422 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905358 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905546 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905495 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08986ec4-a575-4f7d-ba76-a278a5666a54-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905546 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905534 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905652 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905575 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tq687\" (UniqueName: \"kubernetes.io/projected/08986ec4-a575-4f7d-ba76-a278a5666a54-kube-api-access-tq687\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905652 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905751 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905665 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.905828 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.905809 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.907440 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.907412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08986ec4-a575-4f7d-ba76-a278a5666a54-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.907735 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.907717 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08986ec4-a575-4f7d-ba76-a278a5666a54-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:24.916611 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:24.916589 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq687\" (UniqueName: \"kubernetes.io/projected/08986ec4-a575-4f7d-ba76-a278a5666a54-kube-api-access-tq687\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8\" (UID: \"08986ec4-a575-4f7d-ba76-a278a5666a54\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:25.052907 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:25.052814 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:25.214410 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:25.214379 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8"] May 21 18:25:25.216441 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:25:25.216369 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08986ec4_a575_4f7d_ba76_a278a5666a54.slice/crio-640f8c94f7ab6bcbb2fb3d678644c740a1407c65e406538a69cd413e89a4575c WatchSource:0}: Error finding container 640f8c94f7ab6bcbb2fb3d678644c740a1407c65e406538a69cd413e89a4575c: Status 404 returned error can't find the container with id 640f8c94f7ab6bcbb2fb3d678644c740a1407c65e406538a69cd413e89a4575c May 21 18:25:25.604288 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:25.604256 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-49nwd" May 21 18:25:25.647171 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:25.647098 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" event={"ID":"08986ec4-a575-4f7d-ba76-a278a5666a54","Type":"ContainerStarted","Data":"640f8c94f7ab6bcbb2fb3d678644c740a1407c65e406538a69cd413e89a4575c"} May 21 18:25:31.677751 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:31.677706 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" event={"ID":"eb31bb6b-7489-49df-9995-430d3747250f","Type":"ContainerStarted","Data":"4ff8dd0dd146c99b61b22565a09a52bb3e4967ef5c791c3e657d10ae01e74a64"} May 21 18:25:31.679482 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:31.679447 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" event={"ID":"08986ec4-a575-4f7d-ba76-a278a5666a54","Type":"ContainerStarted","Data":"6ca80d67c7093b3af03d7fa02111d9856e6bb8dc628042c02325431d53e4877b"} May 21 18:25:37.715353 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:37.715315 2555 generic.go:358] "Generic (PLEG): container finished" podID="08986ec4-a575-4f7d-ba76-a278a5666a54" containerID="6ca80d67c7093b3af03d7fa02111d9856e6bb8dc628042c02325431d53e4877b" exitCode=0 May 21 18:25:37.715894 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:37.715398 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" event={"ID":"08986ec4-a575-4f7d-ba76-a278a5666a54","Type":"ContainerDied","Data":"6ca80d67c7093b3af03d7fa02111d9856e6bb8dc628042c02325431d53e4877b"} May 21 18:25:37.717363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:37.716966 2555 generic.go:358] "Generic (PLEG): container finished" podID="eb31bb6b-7489-49df-9995-430d3747250f" containerID="4ff8dd0dd146c99b61b22565a09a52bb3e4967ef5c791c3e657d10ae01e74a64" exitCode=0 May 21 18:25:37.717363 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:37.717033 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" event={"ID":"eb31bb6b-7489-49df-9995-430d3747250f","Type":"ContainerDied","Data":"4ff8dd0dd146c99b61b22565a09a52bb3e4967ef5c791c3e657d10ae01e74a64"} May 21 18:25:39.727924 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:39.727889 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" event={"ID":"08986ec4-a575-4f7d-ba76-a278a5666a54","Type":"ContainerStarted","Data":"eb21d0dfe324f704683aff62dbbab501e716701be02aabb1dfbbb6d2100998f5"} May 21 18:25:39.728385 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:39.728150 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:25:39.729708 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:39.729676 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" event={"ID":"eb31bb6b-7489-49df-9995-430d3747250f","Type":"ContainerStarted","Data":"0b373476348fdd7b4f7f095ff0155a72aa9b028fbe035c0319e6e68562e9f2f1"} May 21 18:25:39.729952 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:39.729924 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:39.765316 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:39.765251 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" podStartSLOduration=1.9417866030000002 podStartE2EDuration="15.765232413s" podCreationTimestamp="2026-05-21 18:25:24 +0000 UTC" firstStartedPulling="2026-05-21 18:25:25.218293936 +0000 UTC m=+694.782385176" lastFinishedPulling="2026-05-21 18:25:39.041739734 +0000 UTC m=+708.605830986" observedRunningTime="2026-05-21 18:25:39.760879599 +0000 UTC m=+709.324970874" watchObservedRunningTime="2026-05-21 18:25:39.765232413 +0000 UTC m=+709.329323674" May 21 18:25:39.803992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:39.803927 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" podStartSLOduration=1.4033943660000001 podStartE2EDuration="15.80390739s" podCreationTimestamp="2026-05-21 18:25:24 +0000 UTC" firstStartedPulling="2026-05-21 18:25:24.636453338 +0000 UTC m=+694.200544579" lastFinishedPulling="2026-05-21 18:25:39.036966351 +0000 UTC m=+708.601057603" observedRunningTime="2026-05-21 18:25:39.797611326 +0000 UTC m=+709.361702589" watchObservedRunningTime="2026-05-21 18:25:39.80390739 +0000 UTC m=+709.367998652" May 21 18:25:50.754358 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:50.754323 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw" May 21 18:25:50.755315 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:25:50.755296 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8" May 21 18:26:05.587844 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.587804 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r"] May 21 18:26:05.617868 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.617831 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r"] May 21 18:26:05.618044 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.617970 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.620339 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.620315 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 18:26:05.711882 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.711822 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqdg\" (UniqueName: \"kubernetes.io/projected/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-kube-api-access-xgqdg\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.711882 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.711884 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.712147 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.711933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.712147 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.711990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.712147 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.712035 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.712265 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.712184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.813743 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.813705 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqdg\" (UniqueName: \"kubernetes.io/projected/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-kube-api-access-xgqdg\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.813743 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.813754 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.814046 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.813783 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.814046 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.813806 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.814046 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.813847 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.814046 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.813977 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.814409 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.814383 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.814591 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.814567 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.814758 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.814404 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.816772 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.816746 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.816968 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.816950 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.823374 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.823331 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqdg\" (UniqueName: \"kubernetes.io/projected/d7380bec-b08b-4229-867d-1a2aa7fb9ed0-kube-api-access-xgqdg\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r\" (UID: \"d7380bec-b08b-4229-867d-1a2aa7fb9ed0\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:05.928919 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:05.928816 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:06.074117 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:06.074064 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r"] May 21 18:26:06.075644 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:26:06.075616 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7380bec_b08b_4229_867d_1a2aa7fb9ed0.slice/crio-f730651044ef362363daa2721d5311c4e8a318ac0a8a3346847afa0c65e85090 WatchSource:0}: Error finding container f730651044ef362363daa2721d5311c4e8a318ac0a8a3346847afa0c65e85090: Status 404 returned error can't find the container with id f730651044ef362363daa2721d5311c4e8a318ac0a8a3346847afa0c65e85090 May 21 18:26:06.848763 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:06.848724 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" event={"ID":"d7380bec-b08b-4229-867d-1a2aa7fb9ed0","Type":"ContainerStarted","Data":"3c28570cdb28fd722eaaf7c8d4a66e5430be3e550546743519ea4873f75fcea2"} May 21 18:26:06.848763 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:06.848766 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" event={"ID":"d7380bec-b08b-4229-867d-1a2aa7fb9ed0","Type":"ContainerStarted","Data":"f730651044ef362363daa2721d5311c4e8a318ac0a8a3346847afa0c65e85090"} May 21 18:26:11.389913 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.389872 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj"] May 21 18:26:11.392992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.392968 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.396064 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.396040 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 18:26:11.406725 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.406692 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj"] May 21 18:26:11.470749 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.470710 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.470948 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.470773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.470948 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.470893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtx4k\" (UniqueName: \"kubernetes.io/projected/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-kube-api-access-mtx4k\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.470948 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.470931 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.471140 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.471000 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.471140 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.471060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.572575 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.572531 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.572762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.572581 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4k\" (UniqueName: \"kubernetes.io/projected/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-kube-api-access-mtx4k\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.572762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.572618 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.572762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.572705 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.572762 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.572733 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.572992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.572785 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.573166 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.573138 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.573384 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.573330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.573600 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.573572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.575013 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.574965 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.575815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.575791 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.582375 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.582352 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtx4k\" (UniqueName: \"kubernetes.io/projected/35b1ea91-6450-4ef0-b2d2-edc5e9a32048-kube-api-access-mtx4k\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7xmpj\" (UID: \"35b1ea91-6450-4ef0-b2d2-edc5e9a32048\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.705691 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.705586 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:11.863981 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:11.863954 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj"] May 21 18:26:11.865947 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:26:11.865919 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b1ea91_6450_4ef0_b2d2_edc5e9a32048.slice/crio-d65e8205477cc32f9cc8257be6cfc30ac91667d7456615ab117ff2e3296dc276 WatchSource:0}: Error finding container d65e8205477cc32f9cc8257be6cfc30ac91667d7456615ab117ff2e3296dc276: Status 404 returned error can't find the container with id d65e8205477cc32f9cc8257be6cfc30ac91667d7456615ab117ff2e3296dc276 May 21 18:26:12.875222 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:12.875100 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" event={"ID":"35b1ea91-6450-4ef0-b2d2-edc5e9a32048","Type":"ContainerStarted","Data":"3f0fb7981f24cfe6df8d0ebaaa7c2c95242d5cc3ad0af18d174f132224f75288"} May 21 18:26:12.875222 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:12.875171 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" event={"ID":"35b1ea91-6450-4ef0-b2d2-edc5e9a32048","Type":"ContainerStarted","Data":"d65e8205477cc32f9cc8257be6cfc30ac91667d7456615ab117ff2e3296dc276"} May 21 18:26:12.876582 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:12.876551 2555 generic.go:358] "Generic (PLEG): container finished" podID="d7380bec-b08b-4229-867d-1a2aa7fb9ed0" containerID="3c28570cdb28fd722eaaf7c8d4a66e5430be3e550546743519ea4873f75fcea2" exitCode=0 May 21 18:26:12.876707 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:12.876619 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" event={"ID":"d7380bec-b08b-4229-867d-1a2aa7fb9ed0","Type":"ContainerDied","Data":"3c28570cdb28fd722eaaf7c8d4a66e5430be3e550546743519ea4873f75fcea2"} May 21 18:26:13.884206 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:13.884157 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" event={"ID":"d7380bec-b08b-4229-867d-1a2aa7fb9ed0","Type":"ContainerStarted","Data":"322d1f0f2e82d1a2a1ed6b2ac97e2770b2b9028d6a8cac536c9ac3cf3cf15683"} May 21 18:26:13.906992 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:13.906936 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" podStartSLOduration=8.71137028 podStartE2EDuration="8.906921099s" podCreationTimestamp="2026-05-21 18:26:05 +0000 UTC" firstStartedPulling="2026-05-21 18:26:12.877231246 +0000 UTC m=+742.441322485" lastFinishedPulling="2026-05-21 18:26:13.072782047 +0000 UTC m=+742.636873304" observedRunningTime="2026-05-21 18:26:13.904466398 +0000 UTC m=+743.468557685" watchObservedRunningTime="2026-05-21 18:26:13.906921099 +0000 UTC m=+743.471012361" May 21 18:26:17.902515 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:17.902422 2555 generic.go:358] "Generic (PLEG): container finished" podID="35b1ea91-6450-4ef0-b2d2-edc5e9a32048" containerID="3f0fb7981f24cfe6df8d0ebaaa7c2c95242d5cc3ad0af18d174f132224f75288" exitCode=0 May 21 18:26:17.902975 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:17.902503 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" event={"ID":"35b1ea91-6450-4ef0-b2d2-edc5e9a32048","Type":"ContainerDied","Data":"3f0fb7981f24cfe6df8d0ebaaa7c2c95242d5cc3ad0af18d174f132224f75288"} May 21 18:26:18.908532 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:18.908496 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" event={"ID":"35b1ea91-6450-4ef0-b2d2-edc5e9a32048","Type":"ContainerStarted","Data":"0aa83935eedb319c18dd9126aec8e9c0c1728850b37ccf0d1eecf679a7b0e3b9"} May 21 18:26:18.908943 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:18.908718 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:26:18.931295 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:18.931241 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" podStartSLOduration=7.713614418 podStartE2EDuration="7.931225466s" podCreationTimestamp="2026-05-21 18:26:11 +0000 UTC" firstStartedPulling="2026-05-21 18:26:17.903309509 +0000 UTC m=+747.467400747" lastFinishedPulling="2026-05-21 18:26:18.120920552 +0000 UTC m=+747.685011795" observedRunningTime="2026-05-21 18:26:18.928632529 +0000 UTC m=+748.492723792" watchObservedRunningTime="2026-05-21 18:26:18.931225466 +0000 UTC m=+748.495316726" May 21 18:26:23.885050 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:23.885011 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:23.897773 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:23.897745 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r" May 21 18:26:29.929866 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:26:29.929836 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7xmpj" May 21 18:27:42.602233 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:42.602196 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84d777b9cf-k7djs"] May 21 18:27:42.602729 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:42.602427 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-84d777b9cf-k7djs" podUID="f5952df4-5a74-4593-b69e-e3752c0bc4f6" containerName="manager" containerID="cri-o://57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6" gracePeriod=30 May 21 18:27:42.858315 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:42.858251 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:27:42.947376 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:42.947337 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfflt\" (UniqueName: \"kubernetes.io/projected/f5952df4-5a74-4593-b69e-e3752c0bc4f6-kube-api-access-dfflt\") pod \"f5952df4-5a74-4593-b69e-e3752c0bc4f6\" (UID: \"f5952df4-5a74-4593-b69e-e3752c0bc4f6\") " May 21 18:27:42.949462 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:42.949429 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5952df4-5a74-4593-b69e-e3752c0bc4f6-kube-api-access-dfflt" (OuterVolumeSpecName: "kube-api-access-dfflt") pod "f5952df4-5a74-4593-b69e-e3752c0bc4f6" (UID: "f5952df4-5a74-4593-b69e-e3752c0bc4f6"). InnerVolumeSpecName "kube-api-access-dfflt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:27:43.048189 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.048152 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfflt\" (UniqueName: \"kubernetes.io/projected/f5952df4-5a74-4593-b69e-e3752c0bc4f6-kube-api-access-dfflt\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:27:43.275965 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.275932 2555 generic.go:358] "Generic (PLEG): container finished" podID="f5952df4-5a74-4593-b69e-e3752c0bc4f6" containerID="57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6" exitCode=0 May 21 18:27:43.276149 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.275968 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d777b9cf-k7djs" event={"ID":"f5952df4-5a74-4593-b69e-e3752c0bc4f6","Type":"ContainerDied","Data":"57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6"} May 21 18:27:43.276149 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.276001 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d777b9cf-k7djs" May 21 18:27:43.276149 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.276014 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d777b9cf-k7djs" event={"ID":"f5952df4-5a74-4593-b69e-e3752c0bc4f6","Type":"ContainerDied","Data":"9855231f004011ad607915c87d7b27387167d8206187dda10209f45337ad4868"} May 21 18:27:43.276149 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.276033 2555 scope.go:117] "RemoveContainer" containerID="57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6" May 21 18:27:43.285099 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.285081 2555 scope.go:117] "RemoveContainer" containerID="57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6" May 21 18:27:43.285341 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:27:43.285325 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6\": container with ID starting with 57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6 not found: ID does not exist" containerID="57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6" May 21 18:27:43.285402 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.285350 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6"} err="failed to get container status \"57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6\": rpc error: code = NotFound desc = could not find container \"57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6\": container with ID starting with 57a6ec5f3f00ba144ba4af949bb154a1e7cff3e2fb66a2e5eeeba4e0150a60c6 not found: ID does not exist" May 21 18:27:43.292344 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.292319 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84d777b9cf-k7djs"] May 21 18:27:43.296343 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:43.296320 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84d777b9cf-k7djs"] May 21 18:27:44.016863 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.016823 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84d777b9cf-rjm8t"] May 21 18:27:44.017428 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.017409 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5952df4-5a74-4593-b69e-e3752c0bc4f6" containerName="manager" May 21 18:27:44.017474 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.017431 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5952df4-5a74-4593-b69e-e3752c0bc4f6" containerName="manager" May 21 18:27:44.017513 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.017508 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5952df4-5a74-4593-b69e-e3752c0bc4f6" containerName="manager" May 21 18:27:44.020798 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.020780 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d777b9cf-rjm8t" May 21 18:27:44.023309 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.023289 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5qzzn\"" May 21 18:27:44.031253 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.031226 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84d777b9cf-rjm8t"] May 21 18:27:44.055530 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.055492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-772g9\" (UniqueName: \"kubernetes.io/projected/317bef45-ce4d-4b3a-bac5-d40e084afdc0-kube-api-access-772g9\") pod \"maas-controller-84d777b9cf-rjm8t\" (UID: \"317bef45-ce4d-4b3a-bac5-d40e084afdc0\") " pod="opendatahub/maas-controller-84d777b9cf-rjm8t" May 21 18:27:44.156431 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.156389 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-772g9\" (UniqueName: \"kubernetes.io/projected/317bef45-ce4d-4b3a-bac5-d40e084afdc0-kube-api-access-772g9\") pod \"maas-controller-84d777b9cf-rjm8t\" (UID: \"317bef45-ce4d-4b3a-bac5-d40e084afdc0\") " pod="opendatahub/maas-controller-84d777b9cf-rjm8t" May 21 18:27:44.165103 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.165062 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-772g9\" (UniqueName: \"kubernetes.io/projected/317bef45-ce4d-4b3a-bac5-d40e084afdc0-kube-api-access-772g9\") pod \"maas-controller-84d777b9cf-rjm8t\" (UID: \"317bef45-ce4d-4b3a-bac5-d40e084afdc0\") " pod="opendatahub/maas-controller-84d777b9cf-rjm8t" May 21 18:27:44.334028 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.333939 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d777b9cf-rjm8t" May 21 18:27:44.475772 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:44.475740 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84d777b9cf-rjm8t"] May 21 18:27:44.477443 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:27:44.477415 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317bef45_ce4d_4b3a_bac5_d40e084afdc0.slice/crio-7a3c536b9451980de976b7fba16e2c6c793414e573234d99dc4b5a7ad17d6dd2 WatchSource:0}: Error finding container 7a3c536b9451980de976b7fba16e2c6c793414e573234d99dc4b5a7ad17d6dd2: Status 404 returned error can't find the container with id 7a3c536b9451980de976b7fba16e2c6c793414e573234d99dc4b5a7ad17d6dd2 May 21 18:27:45.028700 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:45.028657 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5952df4-5a74-4593-b69e-e3752c0bc4f6" path="/var/lib/kubelet/pods/f5952df4-5a74-4593-b69e-e3752c0bc4f6/volumes" May 21 18:27:45.286765 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:45.286721 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d777b9cf-rjm8t" event={"ID":"317bef45-ce4d-4b3a-bac5-d40e084afdc0","Type":"ContainerStarted","Data":"28fe7dade9081b5b9526f3e9f32559f0347bb8e4e0288cd1cefc62be83e29969"} May 21 18:27:45.286765 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:45.286769 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d777b9cf-rjm8t" event={"ID":"317bef45-ce4d-4b3a-bac5-d40e084afdc0","Type":"ContainerStarted","Data":"7a3c536b9451980de976b7fba16e2c6c793414e573234d99dc4b5a7ad17d6dd2"} May 21 18:27:45.287031 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:45.286824 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84d777b9cf-rjm8t" May 21 18:27:45.302823 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:45.302764 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-84d777b9cf-rjm8t" podStartSLOduration=1.861030833 podStartE2EDuration="2.302748783s" podCreationTimestamp="2026-05-21 18:27:43 +0000 UTC" firstStartedPulling="2026-05-21 18:27:44.478853257 +0000 UTC m=+834.042944496" lastFinishedPulling="2026-05-21 18:27:44.920571203 +0000 UTC m=+834.484662446" observedRunningTime="2026-05-21 18:27:45.301970504 +0000 UTC m=+834.866061767" watchObservedRunningTime="2026-05-21 18:27:45.302748783 +0000 UTC m=+834.866840045" May 21 18:27:56.296659 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:27:56.296625 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84d777b9cf-rjm8t" May 21 18:28:50.956349 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:28:50.956267 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:28:50.959089 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:28:50.959064 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:33:50.992008 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:33:50.991980 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:33:50.994766 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:33:50.994740 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:38:04.365717 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.365633 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5"] May 21 18:38:04.368035 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.365899 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" podUID="9cd87199-306d-4254-a035-9d99be351b9b" containerName="manager" containerID="cri-o://a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75" gracePeriod=10 May 21 18:38:04.723360 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.723334 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:38:04.861177 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.861093 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmn69\" (UniqueName: \"kubernetes.io/projected/9cd87199-306d-4254-a035-9d99be351b9b-kube-api-access-rmn69\") pod \"9cd87199-306d-4254-a035-9d99be351b9b\" (UID: \"9cd87199-306d-4254-a035-9d99be351b9b\") " May 21 18:38:04.861177 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.861159 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cd87199-306d-4254-a035-9d99be351b9b-extensions-socket-volume\") pod \"9cd87199-306d-4254-a035-9d99be351b9b\" (UID: \"9cd87199-306d-4254-a035-9d99be351b9b\") " May 21 18:38:04.861556 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.861533 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd87199-306d-4254-a035-9d99be351b9b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9cd87199-306d-4254-a035-9d99be351b9b" (UID: "9cd87199-306d-4254-a035-9d99be351b9b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:38:04.863214 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.863189 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd87199-306d-4254-a035-9d99be351b9b-kube-api-access-rmn69" (OuterVolumeSpecName: "kube-api-access-rmn69") pod "9cd87199-306d-4254-a035-9d99be351b9b" (UID: "9cd87199-306d-4254-a035-9d99be351b9b"). InnerVolumeSpecName "kube-api-access-rmn69". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:38:04.889069 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.888991 2555 generic.go:358] "Generic (PLEG): container finished" podID="9cd87199-306d-4254-a035-9d99be351b9b" containerID="a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75" exitCode=0 May 21 18:38:04.889069 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.889053 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" May 21 18:38:04.889069 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.889062 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" event={"ID":"9cd87199-306d-4254-a035-9d99be351b9b","Type":"ContainerDied","Data":"a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75"} May 21 18:38:04.889315 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.889092 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5" event={"ID":"9cd87199-306d-4254-a035-9d99be351b9b","Type":"ContainerDied","Data":"d0c64f0fed040262eda700363d8d2187bb8286ee91798e117039b2aa299d8ad4"} May 21 18:38:04.889315 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.889129 2555 scope.go:117] "RemoveContainer" containerID="a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75" May 21 18:38:04.898756 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.898736 2555 scope.go:117] "RemoveContainer" containerID="a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75" May 21 18:38:04.899013 ip-10-0-138-244 kubenswrapper[2555]: E0521 18:38:04.898995 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75\": container with ID starting with a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75 not found: ID does not exist" containerID="a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75" May 21 18:38:04.899063 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.899021 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75"} err="failed to get container status \"a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75\": rpc error: code = NotFound desc = could not find container \"a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75\": container with ID starting with a63a98524d128b29f73addafb73b622f9a2abc294a94ccdcb17dd1632ce5bb75 not found: ID does not exist" May 21 18:38:04.910272 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.910246 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5"] May 21 18:38:04.916254 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.916233 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fnrc5"] May 21 18:38:04.961912 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.961884 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmn69\" (UniqueName: \"kubernetes.io/projected/9cd87199-306d-4254-a035-9d99be351b9b-kube-api-access-rmn69\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:38:04.961912 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:04.961909 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cd87199-306d-4254-a035-9d99be351b9b-extensions-socket-volume\") on node \"ip-10-0-138-244.ec2.internal\" DevicePath \"\"" May 21 18:38:05.022824 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:05.022778 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd87199-306d-4254-a035-9d99be351b9b" path="/var/lib/kubelet/pods/9cd87199-306d-4254-a035-9d99be351b9b/volumes" May 21 18:38:51.029381 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:51.029354 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:38:51.034413 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:38:51.034384 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:39:10.527262 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.527176 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t"] May 21 18:39:10.527629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.527607 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd87199-306d-4254-a035-9d99be351b9b" containerName="manager" May 21 18:39:10.527629 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.527620 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd87199-306d-4254-a035-9d99be351b9b" containerName="manager" May 21 18:39:10.527702 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.527692 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="9cd87199-306d-4254-a035-9d99be351b9b" containerName="manager" May 21 18:39:10.530613 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.530594 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:10.532898 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.532872 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k6dnk\"" May 21 18:39:10.544685 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.544659 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t"] May 21 18:39:10.684695 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.684659 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c599403e-fa66-4153-b668-c8d939cb655f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n6v7t\" (UID: \"c599403e-fa66-4153-b668-c8d939cb655f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:10.684890 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.684841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhz85\" (UniqueName: \"kubernetes.io/projected/c599403e-fa66-4153-b668-c8d939cb655f-kube-api-access-lhz85\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n6v7t\" (UID: \"c599403e-fa66-4153-b668-c8d939cb655f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:10.786382 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.786297 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhz85\" (UniqueName: \"kubernetes.io/projected/c599403e-fa66-4153-b668-c8d939cb655f-kube-api-access-lhz85\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n6v7t\" (UID: \"c599403e-fa66-4153-b668-c8d939cb655f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:10.786382 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.786363 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c599403e-fa66-4153-b668-c8d939cb655f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n6v7t\" (UID: \"c599403e-fa66-4153-b668-c8d939cb655f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:10.786796 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.786776 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c599403e-fa66-4153-b668-c8d939cb655f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n6v7t\" (UID: \"c599403e-fa66-4153-b668-c8d939cb655f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:10.795072 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.795042 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhz85\" (UniqueName: \"kubernetes.io/projected/c599403e-fa66-4153-b668-c8d939cb655f-kube-api-access-lhz85\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n6v7t\" (UID: \"c599403e-fa66-4153-b668-c8d939cb655f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:10.841914 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.841883 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:10.985738 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.985702 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t"] May 21 18:39:10.986464 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:39:10.986441 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc599403e_fa66_4153_b668_c8d939cb655f.slice/crio-10be7be602dd908ec7656f7ca979dad0516cffaff9b108233d4c254e44c99c43 WatchSource:0}: Error finding container 10be7be602dd908ec7656f7ca979dad0516cffaff9b108233d4c254e44c99c43: Status 404 returned error can't find the container with id 10be7be602dd908ec7656f7ca979dad0516cffaff9b108233d4c254e44c99c43 May 21 18:39:10.988906 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:10.988881 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:39:11.172043 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:11.172003 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" event={"ID":"c599403e-fa66-4153-b668-c8d939cb655f","Type":"ContainerStarted","Data":"010e6323c1ff2cdd38b5b828405d9abbbc44b2f03ea178317f6d0f11609a5ac0"} May 21 18:39:11.172043 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:11.172043 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" event={"ID":"c599403e-fa66-4153-b668-c8d939cb655f","Type":"ContainerStarted","Data":"10be7be602dd908ec7656f7ca979dad0516cffaff9b108233d4c254e44c99c43"} May 21 18:39:11.172283 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:11.172081 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:39:11.195997 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:11.195945 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" podStartSLOduration=1.195930858 podStartE2EDuration="1.195930858s" podCreationTimestamp="2026-05-21 18:39:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:39:11.192954778 +0000 UTC m=+1520.757046082" watchObservedRunningTime="2026-05-21 18:39:11.195930858 +0000 UTC m=+1520.760022119" May 21 18:39:22.177523 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:39:22.177488 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n6v7t" May 21 18:43:51.064395 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:43:51.064364 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:43:51.071318 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:43:51.071295 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:48:51.098085 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:51.098054 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:48:51.107893 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:51.107871 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:48:51.925613 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:51.925583 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-866d866747-wp7sx_44cc6c67-7d41-40a8-8659-ed0119c4f9da/maas-api/0.log" May 21 18:48:52.291490 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:52.291461 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84d777b9cf-rjm8t_317bef45-ce4d-4b3a-bac5-d40e084afdc0/manager/0.log" May 21 18:48:52.747815 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:52.747780 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5948ffb7d5-zcfvj_98eb1f16-e403-4cf5-8e1d-f019bd78ebd5/manager/0.log" May 21 18:48:53.606638 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.606608 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n_8a67a799-b79e-467b-8fb2-0877392b2dc5/util/0.log" May 21 18:48:53.613347 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.613320 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n_8a67a799-b79e-467b-8fb2-0877392b2dc5/pull/0.log" May 21 18:48:53.619232 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.619205 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n_8a67a799-b79e-467b-8fb2-0877392b2dc5/extract/0.log" May 21 18:48:53.725610 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.725577 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4_3e9f1004-e91c-47d1-a509-5ef0336a5c00/util/0.log" May 21 18:48:53.731954 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.731928 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4_3e9f1004-e91c-47d1-a509-5ef0336a5c00/pull/0.log" May 21 18:48:53.737905 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.737876 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4_3e9f1004-e91c-47d1-a509-5ef0336a5c00/extract/0.log" May 21 18:48:53.849237 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.849206 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6_60da7a16-3989-4e55-8131-01bab1f37b5c/util/0.log" May 21 18:48:53.855619 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.855596 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6_60da7a16-3989-4e55-8131-01bab1f37b5c/pull/0.log" May 21 18:48:53.862196 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.862099 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6_60da7a16-3989-4e55-8131-01bab1f37b5c/extract/0.log" May 21 18:48:53.968728 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.968700 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8_8eac61bd-c080-44da-92c8-e22b19a7cc44/util/0.log" May 21 18:48:53.975380 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.975348 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8_8eac61bd-c080-44da-92c8-e22b19a7cc44/pull/0.log" May 21 18:48:53.981669 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:53.981642 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8_8eac61bd-c080-44da-92c8-e22b19a7cc44/extract/0.log" May 21 18:48:54.337125 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:54.337083 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-fsk4l_ebb7240f-5572-4a5a-843b-7f0cbee53d80/manager/0.log" May 21 18:48:54.442018 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:54.441987 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-h7sql_687f078b-cc03-44f0-a291-562c24e98c54/kuadrant-console-plugin/0.log" May 21 18:48:54.563877 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:54.563825 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hfpz6_ba25eebd-7530-4ed8-a7d1-1d087694f85f/registry-server/0.log" May 21 18:48:54.689053 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:54.688967 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-n6v7t_c599403e-fa66-4153-b668-c8d939cb655f/manager/0.log" May 21 18:48:55.249684 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:55.249651 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b97kw5_b3d5f384-3a9d-4aa4-b80f-e6a09976b969/istio-proxy/0.log" May 21 18:48:55.691583 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:55.691500 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-kkdnn_d2c320db-771d-4480-8904-d9245337352d/istio-proxy/0.log" May 21 18:48:55.809922 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:55.809886 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-49nwd_c7d9ed13-212e-4845-8977-8c50bc0b0683/payload-processing/0.log" May 21 18:48:55.919924 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:55.919888 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f797b8564-xnzdb_cd0bb322-8104-4cdf-b79f-1a5eed62f559/router/0.log" May 21 18:48:56.242656 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:56.242595 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r_d7380bec-b08b-4229-867d-1a2aa7fb9ed0/storage-initializer/0.log" May 21 18:48:56.249950 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:56.249925 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-sbq4r_d7380bec-b08b-4229-867d-1a2aa7fb9ed0/main/0.log" May 21 18:48:56.470691 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:56.470650 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-7xmpj_35b1ea91-6450-4ef0-b2d2-edc5e9a32048/storage-initializer/0.log" May 21 18:48:56.478082 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:56.478052 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-7xmpj_35b1ea91-6450-4ef0-b2d2-edc5e9a32048/main/0.log" May 21 18:48:56.586020 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:56.585943 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw_eb31bb6b-7489-49df-9995-430d3747250f/main/0.log" May 21 18:48:56.592465 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:56.592443 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcchqpkw_eb31bb6b-7489-49df-9995-430d3747250f/storage-initializer/0.log" May 21 18:48:56.705926 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:56.705896 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8_08986ec4-a575-4f7d-ba76-a278a5666a54/storage-initializer/0.log" May 21 18:48:56.713553 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:48:56.713529 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-f5jw8_08986ec4-a575-4f7d-ba76-a278a5666a54/main/0.log" May 21 18:49:04.320307 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:04.320269 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zwkm2_ab7c4ab5-35d9-440d-a0d5-e8b2e10cdbff/global-pull-secret-syncer/0.log" May 21 18:49:04.372407 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:04.372378 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-62l8t_f6673235-c26d-44ce-bb74-415390b94b13/konnectivity-agent/0.log" May 21 18:49:04.463186 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:04.463151 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-244.ec2.internal_17c8340ff36fd99f490f39bff53685ee/haproxy/0.log" May 21 18:49:07.923304 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:07.923266 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n_8a67a799-b79e-467b-8fb2-0877392b2dc5/extract/0.log" May 21 18:49:07.953345 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:07.953317 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n_8a67a799-b79e-467b-8fb2-0877392b2dc5/util/0.log" May 21 18:49:08.009593 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.009566 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592wg8n_8a67a799-b79e-467b-8fb2-0877392b2dc5/pull/0.log" May 21 18:49:08.077150 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.077120 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4_3e9f1004-e91c-47d1-a509-5ef0336a5c00/extract/0.log" May 21 18:49:08.168549 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.168456 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4_3e9f1004-e91c-47d1-a509-5ef0336a5c00/util/0.log" May 21 18:49:08.199559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.199530 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ff4v4_3e9f1004-e91c-47d1-a509-5ef0336a5c00/pull/0.log" May 21 18:49:08.231753 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.231722 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6_60da7a16-3989-4e55-8131-01bab1f37b5c/extract/0.log" May 21 18:49:08.254044 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.254013 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6_60da7a16-3989-4e55-8131-01bab1f37b5c/util/0.log" May 21 18:49:08.280392 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.280360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cc8w6_60da7a16-3989-4e55-8131-01bab1f37b5c/pull/0.log" May 21 18:49:08.320318 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.320285 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8_8eac61bd-c080-44da-92c8-e22b19a7cc44/extract/0.log" May 21 18:49:08.380581 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.380554 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8_8eac61bd-c080-44da-92c8-e22b19a7cc44/util/0.log" May 21 18:49:08.408656 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.408626 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wcgn8_8eac61bd-c080-44da-92c8-e22b19a7cc44/pull/0.log" May 21 18:49:08.805544 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.805514 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-fsk4l_ebb7240f-5572-4a5a-843b-7f0cbee53d80/manager/0.log" May 21 18:49:08.835221 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.835198 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-h7sql_687f078b-cc03-44f0-a291-562c24e98c54/kuadrant-console-plugin/0.log" May 21 18:49:08.882521 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.882493 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hfpz6_ba25eebd-7530-4ed8-a7d1-1d087694f85f/registry-server/0.log" May 21 18:49:08.983524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:08.983477 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-n6v7t_c599403e-fa66-4153-b668-c8d939cb655f/manager/0.log" May 21 18:49:10.682497 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:10.682464 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-7skkw_af16bf09-0e98-4f24-9571-f94284be67ee/cluster-monitoring-operator/0.log" May 21 18:49:10.722084 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:10.722051 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-98k55_917a4780-e548-4ea4-9024-e9ed09cc4409/kube-state-metrics/0.log" May 21 18:49:10.739689 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:10.739660 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-98k55_917a4780-e548-4ea4-9024-e9ed09cc4409/kube-rbac-proxy-main/0.log" May 21 18:49:10.769630 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:10.769603 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-98k55_917a4780-e548-4ea4-9024-e9ed09cc4409/kube-rbac-proxy-self/0.log" May 21 18:49:10.845920 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:10.845881 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-ktmhl_d12c3ec0-ace1-4642-b84a-fcd98bceac54/monitoring-plugin/0.log" May 21 18:49:10.980628 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:10.980600 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llg4s_17d5962a-b8de-457a-8094-df004dcabdf0/node-exporter/0.log" May 21 18:49:11.007478 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:11.007446 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llg4s_17d5962a-b8de-457a-8094-df004dcabdf0/kube-rbac-proxy/0.log" May 21 18:49:11.030367 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:11.030335 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llg4s_17d5962a-b8de-457a-8094-df004dcabdf0/init-textfile/0.log" May 21 18:49:11.470155 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:11.470128 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-n5vtg_7d5efd72-e838-49b4-8be3-f7e688e49b66/prometheus-operator/0.log" May 21 18:49:11.488588 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:11.488562 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-n5vtg_7d5efd72-e838-49b4-8be3-f7e688e49b66/kube-rbac-proxy/0.log" May 21 18:49:11.517357 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:11.517332 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-9hxlq_62496169-eb04-4977-a853-2284db734f9a/prometheus-operator-admission-webhook/0.log" May 21 18:49:12.878478 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.878447 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm"] May 21 18:49:12.882304 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.882285 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:12.885346 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.885314 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44fjf\"/\"kube-root-ca.crt\"" May 21 18:49:12.885478 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.885315 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44fjf\"/\"default-dockercfg-h4s9z\"" May 21 18:49:12.885478 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.885315 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44fjf\"/\"openshift-service-ca.crt\"" May 21 18:49:12.891196 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.891173 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm"] May 21 18:49:12.913459 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.913424 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-khmbf_2acffa6e-505b-4ad8-9148-e3902dd73951/networking-console-plugin/0.log" May 21 18:49:12.967370 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.967338 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8zc\" (UniqueName: \"kubernetes.io/projected/7b780470-88d2-4e73-ae89-8cf17b105b1a-kube-api-access-fs8zc\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:12.967527 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.967395 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-sys\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:12.967527 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.967475 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-podres\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:12.967612 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.967566 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-lib-modules\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:12.967654 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:12.967613 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-proc\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069075 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069035 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-sys\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069297 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069087 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-podres\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069297 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069181 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-lib-modules\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069297 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069215 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-proc\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069297 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069178 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-sys\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069297 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069265 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-podres\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069297 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069272 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8zc\" (UniqueName: \"kubernetes.io/projected/7b780470-88d2-4e73-ae89-8cf17b105b1a-kube-api-access-fs8zc\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069541 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069317 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-lib-modules\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.069541 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.069328 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b780470-88d2-4e73-ae89-8cf17b105b1a-proc\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.081354 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.081329 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8zc\" (UniqueName: \"kubernetes.io/projected/7b780470-88d2-4e73-ae89-8cf17b105b1a-kube-api-access-fs8zc\") pod \"perf-node-gather-daemonset-xn6wm\" (UID: \"7b780470-88d2-4e73-ae89-8cf17b105b1a\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.193411 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.193319 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.327352 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.327241 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm"] May 21 18:49:13.329797 ip-10-0-138-244 kubenswrapper[2555]: W0521 18:49:13.329762 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7b780470_88d2_4e73_ae89_8cf17b105b1a.slice/crio-577af28dab15cce7a8b078c34643db4386f8fdf35b9609881d4cb76dd45a56f2 WatchSource:0}: Error finding container 577af28dab15cce7a8b078c34643db4386f8fdf35b9609881d4cb76dd45a56f2: Status 404 returned error can't find the container with id 577af28dab15cce7a8b078c34643db4386f8fdf35b9609881d4cb76dd45a56f2 May 21 18:49:13.331435 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.331417 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:49:13.492015 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.491989 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/2.log" May 21 18:49:13.500036 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.499998 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-4jwdp_bb32b748-2aa4-49af-aa2a-75f4bd4a20e2/console-operator/3.log" May 21 18:49:13.738838 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.738805 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" event={"ID":"7b780470-88d2-4e73-ae89-8cf17b105b1a","Type":"ContainerStarted","Data":"46505962dc93380d74790453acdd0f9f78913e813a8568510a9904f220972ad1"} May 21 18:49:13.738838 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.738843 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" event={"ID":"7b780470-88d2-4e73-ae89-8cf17b105b1a","Type":"ContainerStarted","Data":"577af28dab15cce7a8b078c34643db4386f8fdf35b9609881d4cb76dd45a56f2"} May 21 18:49:13.739071 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.738904 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:13.756658 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.756567 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" podStartSLOduration=1.7565530520000001 podStartE2EDuration="1.756553052s" podCreationTimestamp="2026-05-21 18:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:49:13.753789416 +0000 UTC m=+2123.317880676" watchObservedRunningTime="2026-05-21 18:49:13.756553052 +0000 UTC m=+2123.320644367" May 21 18:49:13.978447 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:13.978415 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-ff696fd8b-c8b2d_22b6f5fb-b519-45f1-98df-c8d6c51a2762/console/0.log" May 21 18:49:14.015524 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:14.015437 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-tp8pr_8fa407f3-0ab6-49e8-a914-93656a5adab6/download-server/0.log" May 21 18:49:14.613369 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:14.613336 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-6lj9f_d21770a8-375b-4c87-a7f5-847d940072d1/volume-data-source-validator/0.log" May 21 18:49:15.487300 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:15.487264 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ml5nd_c054bab1-a1e6-4166-afe9-c02f7cf4a0bd/dns/0.log" May 21 18:49:15.508257 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:15.508232 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ml5nd_c054bab1-a1e6-4166-afe9-c02f7cf4a0bd/kube-rbac-proxy/0.log" May 21 18:49:15.670559 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:15.670528 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jl9vw_a8bfa48b-d2e0-4202-a074-f0dfff223c4a/dns-node-resolver/0.log" May 21 18:49:16.208763 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:16.208731 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hrv95_5493a7d9-c08d-4fdb-9917-ee56c14088ce/node-ca/0.log" May 21 18:49:17.140280 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:17.140252 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b97kw5_b3d5f384-3a9d-4aa4-b80f-e6a09976b969/istio-proxy/0.log" May 21 18:49:17.368613 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:17.368576 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-kkdnn_d2c320db-771d-4480-8904-d9245337352d/istio-proxy/0.log" May 21 18:49:17.460219 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:17.460129 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-49nwd_c7d9ed13-212e-4845-8977-8c50bc0b0683/payload-processing/0.log" May 21 18:49:17.490024 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:17.489994 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f797b8564-xnzdb_cd0bb322-8104-4cdf-b79f-1a5eed62f559/router/0.log" May 21 18:49:18.066973 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:18.066941 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqs4r_0e84d92d-02a2-436b-a0dd-92d3d7891a7b/serve-healthcheck-canary/0.log" May 21 18:49:18.505773 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:18.505740 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-spwhr_d55c7689-dc4f-42f9-a8db-dc3270bb60e8/insights-operator/0.log" May 21 18:49:18.507333 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:18.507312 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-spwhr_d55c7689-dc4f-42f9-a8db-dc3270bb60e8/insights-operator/1.log" May 21 18:49:18.532692 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:18.532662 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gk69_afd0da26-ca98-4791-bbab-b288a7010fdf/kube-rbac-proxy/0.log" May 21 18:49:18.556410 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:18.556379 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gk69_afd0da26-ca98-4791-bbab-b288a7010fdf/exporter/0.log" May 21 18:49:18.580482 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:18.580457 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gk69_afd0da26-ca98-4791-bbab-b288a7010fdf/extractor/0.log" May 21 18:49:19.752796 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:19.752766 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-xn6wm" May 21 18:49:20.652994 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:20.652960 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-866d866747-wp7sx_44cc6c67-7d41-40a8-8659-ed0119c4f9da/maas-api/0.log" May 21 18:49:20.815904 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:20.815866 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84d777b9cf-rjm8t_317bef45-ce4d-4b3a-bac5-d40e084afdc0/manager/0.log" May 21 18:49:20.955786 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:20.955691 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5948ffb7d5-zcfvj_98eb1f16-e403-4cf5-8e1d-f019bd78ebd5/manager/0.log" May 21 18:49:22.375674 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:22.375635 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-99f48c84-vtwkp_34680e2d-1763-4907-9041-7f39a447fcff/manager/0.log" May 21 18:49:28.142866 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.142841 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j82jz_3d0e470d-d4b0-49a8-877b-082639da824c/kube-multus-additional-cni-plugins/0.log" May 21 18:49:28.166208 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.166172 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j82jz_3d0e470d-d4b0-49a8-877b-082639da824c/egress-router-binary-copy/0.log" May 21 18:49:28.189413 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.189376 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j82jz_3d0e470d-d4b0-49a8-877b-082639da824c/cni-plugins/0.log" May 21 18:49:28.210459 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.210429 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j82jz_3d0e470d-d4b0-49a8-877b-082639da824c/bond-cni-plugin/0.log" May 21 18:49:28.233430 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.233398 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j82jz_3d0e470d-d4b0-49a8-877b-082639da824c/routeoverride-cni/0.log" May 21 18:49:28.256450 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.256427 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j82jz_3d0e470d-d4b0-49a8-877b-082639da824c/whereabouts-cni-bincopy/0.log" May 21 18:49:28.282448 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.282422 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j82jz_3d0e470d-d4b0-49a8-877b-082639da824c/whereabouts-cni/0.log" May 21 18:49:28.667018 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.666980 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cdm4l_56921e05-de60-4edd-9ec7-26b8855265f0/kube-multus/0.log" May 21 18:49:28.723711 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.723667 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b8mgd_4e102289-f8a8-475e-8f4e-422e0a01eed3/network-metrics-daemon/0.log" May 21 18:49:28.743616 ip-10-0-138-244 kubenswrapper[2555]: I0521 18:49:28.743591 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b8mgd_4e102289-f8a8-475e-8f4e-422e0a01eed3/kube-rbac-proxy/0.log"