May 21 11:41:03.020237 ip-10-0-129-255 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 11:41:03.020253 ip-10-0-129-255 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 11:41:03.020263 ip-10-0-129-255 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 11:41:03.020636 ip-10-0-129-255 systemd[1]: Failed to start Kubernetes Kubelet. May 21 11:41:13.070662 ip-10-0-129-255 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 11:41:13.070680 ip-10-0-129-255 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 75cc87d2d7ba48a79d3042242186078a -- May 21 11:43:46.453574 ip-10-0-129-255 systemd[1]: Starting Kubernetes Kubelet... May 21 11:43:46.896629 ip-10-0-129-255 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 11:43:46.896629 ip-10-0-129-255 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 11:43:46.896629 ip-10-0-129-255 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 11:43:46.896629 ip-10-0-129-255 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 11:43:46.896629 ip-10-0-129-255 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 11:43:46.898408 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.898322 2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 11:43:46.901833 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901813 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:43:46.901833 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901832 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:43:46.901833 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901837 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901842 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901846 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901851 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901855 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901858 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901863 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901867 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901870 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901874 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901878 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901881 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901885 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901889 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901892 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901896 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901908 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901912 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901916 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901920 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:43:46.902020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901924 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901927 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901932 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901936 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901940 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901944 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901948 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901952 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901956 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901960 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901964 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901968 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901972 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901978 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901985 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901990 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.901995 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902000 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902004 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:43:46.902858 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902008 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902012 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902016 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902022 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902026 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902030 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902034 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902038 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902042 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902046 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902051 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902056 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902061 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902065 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902068 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902072 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902076 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902080 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902084 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902089 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:43:46.903627 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902094 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902098 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902102 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902106 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902110 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902114 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902118 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902125 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902129 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902134 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902139 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902143 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902147 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902151 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902155 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902159 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902162 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902166 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902170 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:43:46.904165 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902176 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902183 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902188 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902193 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902198 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902202 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902809 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902817 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902822 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902827 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902831 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902835 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902840 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902844 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902848 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902853 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902858 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902862 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902866 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:43:46.904750 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902870 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902874 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902880 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902886 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902891 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902896 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902900 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902904 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902908 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902912 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902916 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902920 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902924 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902928 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902932 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902936 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902940 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902945 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902949 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902954 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:43:46.905248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902958 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902961 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902966 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902969 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902974 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902978 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902982 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902985 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902989 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.902996 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903002 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903006 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903011 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903017 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903022 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903026 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903030 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903034 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903038 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903044 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:43:46.905775 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903048 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903052 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903057 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903061 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903065 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903069 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903073 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903078 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903081 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903085 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903144 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903457 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903465 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903472 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903477 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903482 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903486 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903491 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903496 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:43:46.906282 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903503 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903508 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903513 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903517 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903527 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903531 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903536 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903541 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903545 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903550 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903554 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903559 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903564 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.903568 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904430 2565 flags.go:64] FLAG: --address="0.0.0.0" May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904472 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904485 2565 flags.go:64] FLAG: --anonymous-auth="true" May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904493 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904500 2565 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904507 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904514 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 11:43:46.906744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904529 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904535 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904540 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904546 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904552 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904557 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904562 2565 flags.go:64] FLAG: --cgroup-root="" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904566 2565 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904571 2565 flags.go:64] FLAG: --client-ca-file="" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904580 2565 flags.go:64] FLAG: --cloud-config="" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904586 2565 flags.go:64] FLAG: --cloud-provider="external" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904591 2565 flags.go:64] FLAG: --cluster-dns="[]" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904598 2565 flags.go:64] FLAG: --cluster-domain="" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904602 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904607 2565 flags.go:64] FLAG: --config-dir="" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904612 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904617 2565 flags.go:64] FLAG: --container-log-max-files="5" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904628 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904633 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904638 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904644 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904649 2565 flags.go:64] FLAG: --contention-profiling="false" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904653 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904659 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904664 2565 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 11:43:46.907252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904669 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904785 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904790 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904793 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904796 2565 flags.go:64] FLAG: --enable-load-reader="false" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904799 2565 flags.go:64] FLAG: --enable-server="true" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904802 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904808 2565 flags.go:64] FLAG: --event-burst="100" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904811 2565 flags.go:64] FLAG: --event-qps="50" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904815 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904818 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904821 2565 flags.go:64] FLAG: --eviction-hard="" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904825 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904828 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904831 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904834 2565 flags.go:64] FLAG: --eviction-soft="" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904837 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904839 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904843 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904846 2565 flags.go:64] FLAG: --experimental-mounter-path="" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904848 2565 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904851 2565 flags.go:64] FLAG: --fail-swap-on="true" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904854 2565 flags.go:64] FLAG: --feature-gates="" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904859 2565 flags.go:64] FLAG: --file-check-frequency="20s" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904862 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 11:43:46.907869 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904866 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904869 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904872 2565 flags.go:64] FLAG: --healthz-port="10248" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904875 2565 flags.go:64] FLAG: --help="false" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904878 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-129-255.ec2.internal" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904881 2565 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904884 2565 flags.go:64] FLAG: --http-check-frequency="20s" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904887 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904891 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904895 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904898 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904901 2565 flags.go:64] FLAG: --image-service-endpoint="" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904904 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904907 2565 flags.go:64] FLAG: --kube-api-burst="100" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904910 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904914 2565 flags.go:64] FLAG: --kube-api-qps="50" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904917 2565 flags.go:64] FLAG: --kube-reserved="" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904920 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904922 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904926 2565 flags.go:64] FLAG: --kubelet-cgroups="" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904928 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904931 2565 flags.go:64] FLAG: --lock-file="" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904934 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904937 2565 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 11:43:46.908479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904940 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904952 2565 flags.go:64] FLAG: --log-json-split-stream="false" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904955 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904957 2565 flags.go:64] FLAG: --log-text-split-stream="false" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904960 2565 flags.go:64] FLAG: --logging-format="text" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904963 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904966 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904969 2565 flags.go:64] FLAG: --manifest-url="" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904972 2565 flags.go:64] FLAG: --manifest-url-header="" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904977 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904980 2565 flags.go:64] FLAG: --max-open-files="1000000" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904984 2565 flags.go:64] FLAG: --max-pods="110" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904987 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904990 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904992 2565 flags.go:64] FLAG: --memory-manager-policy="None" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.904996 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905000 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905003 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905006 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905014 2565 flags.go:64] FLAG: --node-status-max-images="50" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905017 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905020 2565 flags.go:64] FLAG: --oom-score-adj="-999" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905023 2565 flags.go:64] FLAG: --pod-cidr="" May 21 11:43:46.909055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905026 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905032 2565 flags.go:64] FLAG: --pod-manifest-path="" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905035 2565 flags.go:64] FLAG: --pod-max-pids="-1" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905038 2565 flags.go:64] FLAG: --pods-per-core="0" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905041 2565 flags.go:64] FLAG: --port="10250" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905044 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905047 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a3d198321853491c" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905050 2565 flags.go:64] FLAG: --qos-reserved="" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905053 2565 flags.go:64] FLAG: --read-only-port="10255" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905056 2565 flags.go:64] FLAG: --register-node="true" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905059 2565 flags.go:64] FLAG: --register-schedulable="true" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905062 2565 flags.go:64] FLAG: --register-with-taints="" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905065 2565 flags.go:64] FLAG: --registry-burst="10" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905068 2565 flags.go:64] FLAG: --registry-qps="5" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905070 2565 flags.go:64] FLAG: --reserved-cpus="" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905073 2565 flags.go:64] FLAG: --reserved-memory="" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905077 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905081 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905085 2565 flags.go:64] FLAG: --rotate-certificates="false" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905087 2565 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905090 2565 flags.go:64] FLAG: --runonce="false" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905093 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905096 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905099 2565 flags.go:64] FLAG: --seccomp-default="false" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905102 2565 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905104 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 11:43:46.909636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905108 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905111 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905114 2565 flags.go:64] FLAG: --storage-driver-password="root" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905117 2565 flags.go:64] FLAG: --storage-driver-secure="false" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905120 2565 flags.go:64] FLAG: --storage-driver-table="stats" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905122 2565 flags.go:64] FLAG: --storage-driver-user="root" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905125 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905128 2565 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905131 2565 flags.go:64] FLAG: --system-cgroups="" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905134 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905140 2565 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905143 2565 flags.go:64] FLAG: --tls-cert-file="" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905146 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905150 2565 flags.go:64] FLAG: --tls-min-version="" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905153 2565 flags.go:64] FLAG: --tls-private-key-file="" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905156 2565 flags.go:64] FLAG: --topology-manager-policy="none" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905158 2565 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905161 2565 flags.go:64] FLAG: --topology-manager-scope="container" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905165 2565 flags.go:64] FLAG: --v="2" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905169 2565 flags.go:64] FLAG: --version="false" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905173 2565 flags.go:64] FLAG: --vmodule="" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905177 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905180 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905295 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:43:46.910303 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905300 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905303 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905307 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905309 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905312 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905314 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905318 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905322 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905330 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905333 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905336 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905339 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905341 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905344 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905347 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905349 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905352 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905355 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905357 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:43:46.910878 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905359 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905362 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905364 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905367 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905369 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905372 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905374 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905376 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905379 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905381 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905384 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905386 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905397 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905400 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905403 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905406 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905408 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905411 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905413 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905416 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905419 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:43:46.911681 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905423 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905425 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905428 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905430 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905433 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905435 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905438 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905440 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905443 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905445 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905448 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905450 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905453 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905456 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905458 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905461 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905463 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905466 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905468 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905471 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:43:46.912575 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905473 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905476 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905478 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905481 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905483 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905487 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905491 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905494 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905497 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905500 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905504 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905506 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905510 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905512 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905515 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905517 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905520 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905522 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905524 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:43:46.913445 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905527 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905529 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905532 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905534 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905536 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.905539 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.905544 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.912926 2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.912946 2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913014 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913023 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913028 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913033 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913038 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913043 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913047 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:43:46.914224 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913053 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913057 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913062 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913066 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913070 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913075 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913079 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913083 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913087 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913091 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913095 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913100 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913104 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913108 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913112 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913116 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913120 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913124 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913129 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:43:46.914654 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913133 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913137 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913141 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913145 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913149 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913155 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913160 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913166 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913174 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913179 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913184 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913188 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913192 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913197 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913201 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913205 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913209 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913213 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913217 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:43:46.915246 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913221 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913226 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913230 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913235 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913239 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913244 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913248 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913252 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913256 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913260 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913264 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913287 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913291 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913295 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913299 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913304 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913308 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913312 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913316 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913322 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:43:46.916058 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913326 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913330 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913334 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913338 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913342 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913347 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913351 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913355 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913358 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913362 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913368 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913373 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913380 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913384 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913397 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913401 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913405 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913409 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913413 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913417 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:43:46.916618 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913421 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.913429 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913584 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913593 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913598 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913602 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913606 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913610 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913614 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913618 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913622 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913627 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913632 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913636 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913640 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 11:43:46.917111 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913644 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913648 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913652 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913656 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913661 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913665 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913669 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913673 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913677 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913681 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913685 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913689 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913693 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913697 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913701 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913705 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913709 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913714 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913718 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 11:43:46.917554 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913722 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913726 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913730 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913734 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913738 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913742 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913746 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913750 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913754 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913758 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913762 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913767 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913771 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913775 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913779 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913784 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913788 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913792 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913796 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913800 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 11:43:46.918375 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913804 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913808 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913814 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913822 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913827 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913831 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913838 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913843 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913848 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913852 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913857 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913861 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913866 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913870 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913874 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913878 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913882 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913886 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913890 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 11:43:46.918972 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913894 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913899 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913903 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913907 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913911 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913916 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913920 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913924 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913928 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913933 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913936 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913941 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913945 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913949 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:46.913953 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 11:43:46.919635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.913960 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 11:43:46.920023 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.914720 2565 server.go:962] "Client rotation is on, will bootstrap in background" May 21 11:43:46.920023 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.919122 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 11:43:46.920228 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.920213 2565 server.go:1019] "Starting client certificate rotation" May 21 11:43:46.920469 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.920334 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 11:43:46.920469 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.920368 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 11:43:46.944893 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.944861 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 11:43:46.947505 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.947489 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 11:43:46.960331 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.960307 2565 log.go:25] "Validated CRI v1 runtime API" May 21 11:43:46.964991 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.964974 2565 log.go:25] "Validated CRI v1 image API" May 21 11:43:46.966210 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.966191 2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 11:43:46.970042 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.970020 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cc23e85c-b3f6-4d64-a6af-233476b6a631:/dev/nvme0n1p3 d2584dbc-0760-4d38-a82f-2ed27d304d46:/dev/nvme0n1p4] May 21 11:43:46.970109 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.970042 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 11:43:46.974241 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.974224 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 11:43:46.974330 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.974169 2565 manager.go:217] Machine: {Timestamp:2026-05-21 11:43:46.973650045 +0000 UTC m=+0.402580903 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099471 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f0cf4528eb471a0b0f1427aec64a SystemUUID:ec26f0cf-4528-eb47-1a0b-0f1427aec64a BootID:75cc87d2-d7ba-48a7-9d30-42242186078a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:96:c2:41:3d:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:96:c2:41:3d:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:75:bf:dd:c2:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 11:43:46.975133 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.975121 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 11:43:46.975257 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.975244 2565 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 11:43:46.977137 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.977110 2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 11:43:46.977324 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.977140 2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-255.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 11:43:46.977412 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.977339 2565 topology_manager.go:138] "Creating topology manager with none policy" May 21 11:43:46.977412 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.977350 2565 container_manager_linux.go:306] "Creating device plugin manager" May 21 11:43:46.977412 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.977361 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 11:43:46.978038 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.978026 2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 11:43:46.979757 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.979745 2565 state_mem.go:36] "Initialized new in-memory state store" May 21 11:43:46.980059 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.980046 2565 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 11:43:46.982260 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.982248 2565 kubelet.go:491] "Attempting to sync node with API server" May 21 11:43:46.982338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.982285 2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 11:43:46.982338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.982303 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 11:43:46.982338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.982316 2565 kubelet.go:397] "Adding apiserver pod source" May 21 11:43:46.982338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.982328 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 11:43:46.983386 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.983372 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 11:43:46.983450 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.983395 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 11:43:46.986495 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.986449 2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 11:43:46.988723 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.988709 2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 11:43:46.989491 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989475 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 11:43:46.989491 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989493 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989499 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989505 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989514 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989521 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989528 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989534 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989544 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989552 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 11:43:46.989613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989561 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 11:43:46.989842 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.989772 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 11:43:46.990678 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.990664 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 11:43:46.990678 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.990677 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 11:43:46.993559 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:46.992474 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 11:43:46.993559 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:46.992553 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 11:43:46.994300 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.994261 2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-255.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 11:43:46.994918 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.994902 2565 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 11:43:46.994987 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.994954 2565 server.go:1295] "Started kubelet" May 21 11:43:46.995106 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.995023 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 11:43:46.995161 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.995103 2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 11:43:46.995193 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.995175 2565 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 11:43:46.995812 ip-10-0-129-255 systemd[1]: Started Kubernetes Kubelet. May 21 11:43:46.996332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.996091 2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 11:43:46.997627 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:46.997613 2565 server.go:317] "Adding debug handlers to kubelet server" May 21 11:43:47.000365 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.000339 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4292m" May 21 11:43:47.002567 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.002549 2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 11:43:47.003356 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.002517 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-255.ec2.internal.18b191f922363b8f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-255.ec2.internal,UID:ip-10-0-129-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-255.ec2.internal,},FirstTimestamp:2026-05-21 11:43:46.994920335 +0000 UTC m=+0.423851193,LastTimestamp:2026-05-21 11:43:46.994920335 +0000 UTC m=+0.423851193,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-255.ec2.internal,}" May 21 11:43:47.003441 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.003404 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 11:43:47.003917 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.003900 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 11:43:47.004108 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.004088 2565 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 11:43:47.004108 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.004103 2565 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 11:43:47.004263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.004156 2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 11:43:47.004263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.004228 2565 reconstruct.go:97] "Volume reconstruction finished" May 21 11:43:47.004263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.004236 2565 reconciler.go:26] "Reconciler: start to sync state" May 21 11:43:47.004592 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.004575 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.004754 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.004742 2565 factory.go:55] Registering systemd factory May 21 11:43:47.004789 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.004782 2565 factory.go:223] Registration of the systemd container factory successfully May 21 11:43:47.005010 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.004995 2565 factory.go:153] Registering CRI-O factory May 21 11:43:47.005061 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.005013 2565 factory.go:223] Registration of the crio container factory successfully May 21 11:43:47.005111 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.005100 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 11:43:47.005142 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.005123 2565 factory.go:103] Registering Raw factory May 21 11:43:47.005142 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.005138 2565 manager.go:1196] Started watching for new ooms in manager May 21 11:43:47.005538 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.005516 2565 manager.go:319] Starting recovery of all containers May 21 11:43:47.006208 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.006174 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4292m" May 21 11:43:47.010608 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.010578 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 11:43:47.010608 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.010589 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 11:43:47.015630 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.015605 2565 manager.go:324] Recovery completed May 21 11:43:47.020921 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.020904 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:43:47.022777 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.022760 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientMemory" May 21 11:43:47.022849 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.022790 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:43:47.022849 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.022801 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientPID" May 21 11:43:47.023365 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.023349 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 11:43:47.023426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.023365 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 11:43:47.023426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.023383 2565 state_mem.go:36] "Initialized new in-memory state store" May 21 11:43:47.025587 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.025574 2565 policy_none.go:49] "None policy: Start" May 21 11:43:47.025651 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.025592 2565 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 11:43:47.025651 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.025605 2565 state_mem.go:35] "Initializing new in-memory state store" May 21 11:43:47.064894 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.064878 2565 manager.go:341] "Starting Device Plugin manager" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.064962 2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.064976 2565 server.go:85] "Starting device plugin registration server" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.065243 2565 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.065255 2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.065350 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.065436 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.065446 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.066002 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 11:43:47.085525 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.066034 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.154462 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.154416 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 11:43:47.155846 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.155813 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 11:43:47.155959 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.155851 2565 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 11:43:47.155959 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.155876 2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 11:43:47.155959 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.155886 2565 kubelet.go:2451] "Starting kubelet main sync loop" May 21 11:43:47.155959 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.155932 2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 11:43:47.158469 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.158447 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:43:47.165382 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.165364 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:43:47.166468 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.166453 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientMemory" May 21 11:43:47.166554 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.166482 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:43:47.166554 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.166492 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientPID" May 21 11:43:47.166554 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.166517 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-255.ec2.internal" May 21 11:43:47.180194 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.180173 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-255.ec2.internal" May 21 11:43:47.180260 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.180198 2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-255.ec2.internal\": node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.209322 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.209295 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.256753 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.256663 2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal"] May 21 11:43:47.256753 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.256754 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:43:47.257696 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.257682 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientMemory" May 21 11:43:47.257777 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.257710 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:43:47.257777 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.257720 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientPID" May 21 11:43:47.259985 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.259972 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:43:47.260197 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.260150 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:47.260286 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.260219 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:43:47.260685 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.260663 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientMemory" May 21 11:43:47.260769 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.260702 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:43:47.260769 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.260720 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientPID" May 21 11:43:47.260872 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.260856 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientMemory" May 21 11:43:47.260911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.260887 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:43:47.260911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.260911 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientPID" May 21 11:43:47.262889 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.262874 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" May 21 11:43:47.262958 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.262904 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 11:43:47.263530 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.263516 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientMemory" May 21 11:43:47.263582 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.263546 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasNoDiskPressure" May 21 11:43:47.263582 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.263561 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeHasSufficientPID" May 21 11:43:47.292155 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.292129 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-255.ec2.internal\" not found" node="ip-10-0-129-255.ec2.internal" May 21 11:43:47.295587 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.295569 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-255.ec2.internal\" not found" node="ip-10-0-129-255.ec2.internal" May 21 11:43:47.310090 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.310063 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.405442 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.405410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4310f6241c908513c7aaf2db6a147e52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal\" (UID: \"4310f6241c908513c7aaf2db6a147e52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:47.405529 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.405444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4310f6241c908513c7aaf2db6a147e52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal\" (UID: \"4310f6241c908513c7aaf2db6a147e52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:47.405529 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.405465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b3377fb9a8b818b500586a2752a7122-config\") pod \"kube-apiserver-proxy-ip-10-0-129-255.ec2.internal\" (UID: \"7b3377fb9a8b818b500586a2752a7122\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" May 21 11:43:47.410436 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.410414 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.506181 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.506149 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4310f6241c908513c7aaf2db6a147e52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal\" (UID: \"4310f6241c908513c7aaf2db6a147e52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:47.506263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.506209 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4310f6241c908513c7aaf2db6a147e52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal\" (UID: \"4310f6241c908513c7aaf2db6a147e52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:47.506263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.506240 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b3377fb9a8b818b500586a2752a7122-config\") pod \"kube-apiserver-proxy-ip-10-0-129-255.ec2.internal\" (UID: \"7b3377fb9a8b818b500586a2752a7122\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" May 21 11:43:47.506360 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.506289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4310f6241c908513c7aaf2db6a147e52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal\" (UID: \"4310f6241c908513c7aaf2db6a147e52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:47.506360 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.506304 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b3377fb9a8b818b500586a2752a7122-config\") pod \"kube-apiserver-proxy-ip-10-0-129-255.ec2.internal\" (UID: \"7b3377fb9a8b818b500586a2752a7122\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" May 21 11:43:47.506360 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.506288 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4310f6241c908513c7aaf2db6a147e52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal\" (UID: \"4310f6241c908513c7aaf2db6a147e52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:47.511326 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.511256 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.594519 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.594460 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:47.598327 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.598303 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" May 21 11:43:47.612185 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.612157 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.712734 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.712690 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.813318 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.813214 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.913760 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:47.913720 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:47.919908 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.919883 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 11:43:47.920040 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:47.920022 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 11:43:48.004319 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.004285 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 11:43:48.010232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.010205 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 11:38:47 +0000 UTC" deadline="2028-02-14 13:43:31.409806078 +0000 UTC" May 21 11:43:48.010232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.010231 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15217h59m43.399577247s" May 21 11:43:48.014499 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:48.014480 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:48.017139 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.017123 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 11:43:48.020319 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.020300 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:43:48.041151 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.041121 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8rwgp" May 21 11:43:48.048909 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.048889 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8rwgp" May 21 11:43:48.114858 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:48.114776 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:48.215650 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:48.215617 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:48.248649 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:48.248611 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4310f6241c908513c7aaf2db6a147e52.slice/crio-eef237542be56b13c7e878ee46eb142425f635faadf4b743de7d0c090213d2b5 WatchSource:0}: Error finding container eef237542be56b13c7e878ee46eb142425f635faadf4b743de7d0c090213d2b5: Status 404 returned error can't find the container with id eef237542be56b13c7e878ee46eb142425f635faadf4b743de7d0c090213d2b5 May 21 11:43:48.248914 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:48.248888 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3377fb9a8b818b500586a2752a7122.slice/crio-abfe4bffb3d0f8fbc5b5c19adc9f67c49d35c1159a7a3617d2e97150a1076bb7 WatchSource:0}: Error finding container abfe4bffb3d0f8fbc5b5c19adc9f67c49d35c1159a7a3617d2e97150a1076bb7: Status 404 returned error can't find the container with id abfe4bffb3d0f8fbc5b5c19adc9f67c49d35c1159a7a3617d2e97150a1076bb7 May 21 11:43:48.252559 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.252543 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:43:48.316735 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:48.316690 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:48.417256 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:48.417187 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:48.518021 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:48.517988 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-255.ec2.internal\" not found" May 21 11:43:48.566812 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.566781 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:43:48.581724 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.581697 2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:43:48.605030 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.604995 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" May 21 11:43:48.618401 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.618371 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 11:43:48.619376 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.619360 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" May 21 11:43:48.626003 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.625985 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 11:43:48.983637 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.983606 2565 apiserver.go:52] "Watching apiserver" May 21 11:43:48.991580 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.991555 2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 11:43:48.991925 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.991896 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-ff7pn","openshift-network-operator/iptables-alerter-q92l2","openshift-ovn-kubernetes/ovnkube-node-t6mf9","kube-system/konnectivity-agent-bf8nd","kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk","openshift-cluster-node-tuning-operator/tuned-hbvbz","openshift-image-registry/node-ca-cxw7j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal","openshift-multus/multus-additional-cni-plugins-lc944","openshift-multus/multus-ksgjn","openshift-dns/node-resolver-fs9s4","openshift-multus/network-metrics-daemon-55klh"] May 21 11:43:48.994370 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.994348 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:48.996552 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.996518 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:48.997402 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.997371 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-stfbh\"" May 21 11:43:48.997523 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.997504 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 11:43:48.997523 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.997514 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 11:43:48.998846 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.998826 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:48.999426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.999401 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 11:43:48.999530 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:48.999511 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 11:43:49.000310 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.000188 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 11:43:49.000310 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.000205 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4j9m4\"" May 21 11:43:49.001078 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.001062 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bf8nd" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.003588 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.003769 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.004008 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.004161 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.004328 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.004541 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.004563 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s8lrm\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.004625 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.004713 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ntj5r\"" May 21 11:43:49.004911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.004775 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 11:43:49.006696 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.006677 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.006786 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.006741 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:49.006936 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.006820 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:43:49.008962 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.008943 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.009710 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.009687 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 11:43:49.010533 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.010511 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 11:43:49.010811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.010779 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-szns8\"" May 21 11:43:49.010878 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.010840 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 11:43:49.013320 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.013298 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 11:43:49.013426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.013335 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r5dxp\"" May 21 11:43:49.013426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.013361 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 11:43:49.013534 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.013301 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 11:43:49.013930 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.013911 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.015461 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysconfig\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015563 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-tmp\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015563 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-cni-bin\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015563 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015526 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-env-overrides\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015563 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovn-node-metrics-cert\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00dbc12c-57b3-4249-b56f-6290e1cea32b-konnectivity-ca\") pod \"konnectivity-agent-bf8nd\" (UID: \"00dbc12c-57b3-4249-b56f-6290e1cea32b\") " pod="kube-system/konnectivity-agent-bf8nd" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-modprobe-d\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-kubernetes\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-run\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-sys\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-var-lib-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-ovn\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n5hx\" (UniqueName: \"kubernetes.io/projected/f6d349e0-5e56-4c99-892c-abc277e52a01-kube-api-access-8n5hx\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00dbc12c-57b3-4249-b56f-6290e1cea32b-agent-certs\") pod \"konnectivity-agent-bf8nd\" (UID: \"00dbc12c-57b3-4249-b56f-6290e1cea32b\") " pod="kube-system/konnectivity-agent-bf8nd" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015746 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-device-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015760 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-host\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-tuned\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-slash\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-cni-netd\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-registration-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysctl-d\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm25q\" (UniqueName: \"kubernetes.io/projected/ae9abcf2-9e8b-4104-aace-509e4aeed93b-kube-api-access-qm25q\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2166ec23-d8f9-47e3-9642-497cf6d70c52-host-slash\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-socket-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-sys-fs\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysctl-conf\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.015969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-kubelet\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-systemd-units\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-node-log\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015975 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.015995 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-systemd\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-lib-modules\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-var-lib-kubelet\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlsnp\" (UniqueName: \"kubernetes.io/projected/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-kube-api-access-tlsnp\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016055 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-systemd\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-etc-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2166ec23-d8f9-47e3-9642-497cf6d70c52-iptables-alerter-script\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz2qh\" (UniqueName: \"kubernetes.io/projected/2166ec23-d8f9-47e3-9642-497cf6d70c52-kube-api-access-jz2qh\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-run-netns\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-log-socket\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovnkube-config\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.016607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovnkube-script-lib\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.017369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:49.017369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016619 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ksgjn" May 21 11:43:49.017369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016641 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 11:43:49.017369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016679 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 11:43:49.017369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.016926 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 11:43:49.017369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.017239 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x7lpb\"" May 21 11:43:49.017369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.017253 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 11:43:49.017369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.017253 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 11:43:49.019435 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.019415 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 11:43:49.019797 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.019778 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.019797 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.019793 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9n5sq\"" May 21 11:43:49.022084 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.022065 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-brzsq\"" May 21 11:43:49.022183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.022092 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:49.022183 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.022152 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:43:49.022446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.022427 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 11:43:49.022534 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.022437 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 11:43:49.050698 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.050667 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 11:38:48 +0000 UTC" deadline="2027-11-05 07:49:13.118267808 +0000 UTC" May 21 11:43:49.050698 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.050698 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12788h5m24.067573105s" May 21 11:43:49.105212 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.105179 2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116605 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jz2qh\" (UniqueName: \"kubernetes.io/projected/2166ec23-d8f9-47e3-9642-497cf6d70c52-kube-api-access-jz2qh\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116660 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovnkube-config\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116706 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovnkube-script-lib\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116735 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-tmp\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116761 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovn-node-metrics-cert\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-serviceca\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv9nh\" (UniqueName: \"kubernetes.io/projected/5026e325-ff9f-4f0f-b706-8e97367bb7db-kube-api-access-cv9nh\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170f995d-960b-4f2c-ab53-c5897a6a27f4-cni-binary-copy\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-cni-bin\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.117048 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.116997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-conf-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117107 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117141 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-modprobe-d\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117168 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-kubernetes\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-modprobe-d\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117405 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00dbc12c-57b3-4249-b56f-6290e1cea32b-agent-certs\") pod \"konnectivity-agent-bf8nd\" (UID: \"00dbc12c-57b3-4249-b56f-6290e1cea32b\") " pod="kube-system/konnectivity-agent-bf8nd" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117427 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-kubernetes\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-socket-dir-parent\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117524 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.117822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117469 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 11:43:49.118234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.117852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovnkube-script-lib\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.118234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovnkube-config\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.118234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-netns\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.118234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118223 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8n5hx\" (UniqueName: \"kubernetes.io/projected/f6d349e0-5e56-4c99-892c-abc277e52a01-kube-api-access-8n5hx\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.118446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-host\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.118446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-cnibin\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.118446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118315 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-host\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.118446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118395 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-tuned\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.118626 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118515 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-slash\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.118626 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-cni-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.118722 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118623 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.118722 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118588 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-slash\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.118722 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-host\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.118722 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:49.118722 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118718 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.118949 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118746 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s2zh\" (UniqueName: \"kubernetes.io/projected/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-kube-api-access-4s2zh\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.118949 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118786 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2166ec23-d8f9-47e3-9642-497cf6d70c52-host-slash\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.118949 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118830 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-socket-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.118949 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2166ec23-d8f9-47e3-9642-497cf6d70c52-host-slash\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.118949 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118947 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysctl-conf\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.119183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.118977 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-kubelet\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119002 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-systemd-units\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119011 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-socket-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.119183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119025 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-node-log\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119085 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-kubelet\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119124 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119168 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-systemd\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.119512 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119199 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-lib-modules\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.119512 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-lib-modules\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.119512 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-node-log\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119658 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119580 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-systemd-units\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119658 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119757 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119699 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-systemd\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.119757 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119742 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlsnp\" (UniqueName: \"kubernetes.io/projected/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-kube-api-access-tlsnp\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.119856 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119776 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-systemd\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119856 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119803 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.119856 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-cnibin\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.120100 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120078 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-systemd\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.120225 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.120225 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.119870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln4qv\" (UniqueName: \"kubernetes.io/projected/170f995d-960b-4f2c-ab53-c5897a6a27f4-kube-api-access-ln4qv\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.120225 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120214 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00dbc12c-57b3-4249-b56f-6290e1cea32b-konnectivity-ca\") pod \"konnectivity-agent-bf8nd\" (UID: \"00dbc12c-57b3-4249-b56f-6290e1cea32b\") " pod="kube-system/konnectivity-agent-bf8nd" May 21 11:43:49.120419 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120257 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2166ec23-d8f9-47e3-9642-497cf6d70c52-iptables-alerter-script\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.120419 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120310 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-run-netns\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.120419 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysctl-conf\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.120419 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120372 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-run-netns\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.120608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120478 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-log-socket\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.120608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-multus-certs\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.120608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120571 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:49.120608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120605 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysconfig\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.120803 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120637 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-cni-bin\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.120803 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9svsl\" (UniqueName: \"kubernetes.io/projected/e8cbcbd3-2160-4238-8029-6d32911a0f6c-kube-api-access-9svsl\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:49.120803 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-cni-multus\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.120803 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-daemon-config\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.120803 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120765 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.120803 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120798 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-run\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120807 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysconfig\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120826 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-sys\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120864 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-var-lib-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120840 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00dbc12c-57b3-4249-b56f-6290e1cea32b-konnectivity-ca\") pod \"konnectivity-agent-bf8nd\" (UID: \"00dbc12c-57b3-4249-b56f-6290e1cea32b\") " pod="kube-system/konnectivity-agent-bf8nd" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120901 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-ovn\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120917 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2166ec23-d8f9-47e3-9642-497cf6d70c52-iptables-alerter-script\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120935 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-kubelet\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-log-socket\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-tmp-dir\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.120981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121018 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-run\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.121077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121068 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-run-ovn\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.121618 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-sys\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.121618 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4rnq\" (UniqueName: \"kubernetes.io/projected/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-kube-api-access-z4rnq\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.121715 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121665 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00dbc12c-57b3-4249-b56f-6290e1cea32b-agent-certs\") pod \"konnectivity-agent-bf8nd\" (UID: \"00dbc12c-57b3-4249-b56f-6290e1cea32b\") " pod="kube-system/konnectivity-agent-bf8nd" May 21 11:43:49.121715 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121691 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-device-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.121810 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-cni-bin\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.121810 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121730 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-cni-netd\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.121810 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-os-release\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.121810 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121788 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae9abcf2-9e8b-4104-aace-509e4aeed93b-ovn-node-metrics-cert\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.121810 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-hosts-file\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121825 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-registration-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-var-lib-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121857 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysctl-d\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121865 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-host-cni-netd\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-registration-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-os-release\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-device-dir\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-k8s-cni-cncf-io\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121973 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-env-overrides\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.121997 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-sys-fs\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-sysctl-d\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.122039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-system-cni-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122069 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-etc-kubernetes\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122095 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qm25q\" (UniqueName: \"kubernetes.io/projected/ae9abcf2-9e8b-4104-aace-509e4aeed93b-kube-api-access-qm25q\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122121 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-var-lib-kubelet\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122147 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-etc-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-hostroot\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-system-cni-dir\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122345 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6d349e0-5e56-4c99-892c-abc277e52a01-sys-fs\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae9abcf2-9e8b-4104-aace-509e4aeed93b-env-overrides\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-var-lib-kubelet\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.122581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.122457 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae9abcf2-9e8b-4104-aace-509e4aeed93b-etc-openvswitch\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.123391 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.123370 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-tmp\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.123555 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.123506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-etc-tuned\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.127024 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.127001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n5hx\" (UniqueName: \"kubernetes.io/projected/f6d349e0-5e56-4c99-892c-abc277e52a01-kube-api-access-8n5hx\") pod \"aws-ebs-csi-driver-node-x6xfk\" (UID: \"f6d349e0-5e56-4c99-892c-abc277e52a01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.127419 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.127400 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz2qh\" (UniqueName: \"kubernetes.io/projected/2166ec23-d8f9-47e3-9642-497cf6d70c52-kube-api-access-jz2qh\") pod \"iptables-alerter-q92l2\" (UID: \"2166ec23-d8f9-47e3-9642-497cf6d70c52\") " pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.130814 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.130791 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 11:43:49.132903 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.132407 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:43:49.132903 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.132430 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:43:49.132903 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.132444 2565 projected.go:194] Error preparing data for projected volume kube-api-access-2ltvs for pod openshift-network-diagnostics/network-check-target-ff7pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:49.132903 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.132503 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs podName:adbaf571-7f00-461b-81e0-25ee4580c0d9 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:49.632482825 +0000 UTC m=+3.061413684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2ltvs" (UniqueName: "kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs") pod "network-check-target-ff7pn" (UID: "adbaf571-7f00-461b-81e0-25ee4580c0d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:49.133862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.133797 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlsnp\" (UniqueName: \"kubernetes.io/projected/6a920b11-b5a2-41b3-a6b5-2e8e82488e5e-kube-api-access-tlsnp\") pod \"tuned-hbvbz\" (UID: \"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e\") " pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.136154 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.136111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm25q\" (UniqueName: \"kubernetes.io/projected/ae9abcf2-9e8b-4104-aace-509e4aeed93b-kube-api-access-qm25q\") pod \"ovnkube-node-t6mf9\" (UID: \"ae9abcf2-9e8b-4104-aace-509e4aeed93b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.162822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.162761 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" event={"ID":"4310f6241c908513c7aaf2db6a147e52","Type":"ContainerStarted","Data":"eef237542be56b13c7e878ee46eb142425f635faadf4b743de7d0c090213d2b5"} May 21 11:43:49.164561 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.164533 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" event={"ID":"7b3377fb9a8b818b500586a2752a7122","Type":"ContainerStarted","Data":"abfe4bffb3d0f8fbc5b5c19adc9f67c49d35c1159a7a3617d2e97150a1076bb7"} May 21 11:43:49.222588 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222549 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.222588 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222591 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-os-release\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222615 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-k8s-cni-cncf-io\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222642 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222667 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-system-cni-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222689 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-etc-kubernetes\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222713 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222736 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-hostroot\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222758 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-system-cni-dir\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222783 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-serviceca\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.222832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222809 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222836 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cv9nh\" (UniqueName: \"kubernetes.io/projected/5026e325-ff9f-4f0f-b706-8e97367bb7db-kube-api-access-cv9nh\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222860 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170f995d-960b-4f2c-ab53-c5897a6a27f4-cni-binary-copy\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222884 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-cni-bin\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222906 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-conf-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222934 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-socket-dir-parent\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222965 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-netns\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.222989 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-host\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223014 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-cnibin\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223043 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-cni-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223071 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223088 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-os-release\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223096 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s2zh\" (UniqueName: \"kubernetes.io/projected/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-kube-api-access-4s2zh\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223156 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-cnibin\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223221 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ln4qv\" (UniqueName: \"kubernetes.io/projected/170f995d-960b-4f2c-ab53-c5897a6a27f4-kube-api-access-ln4qv\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223223 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223255 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-multus-certs\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-system-cni-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223322 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9svsl\" (UniqueName: \"kubernetes.io/projected/e8cbcbd3-2160-4238-8029-6d32911a0f6c-kube-api-access-9svsl\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223360 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-cni-multus\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223372 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-k8s-cni-cncf-io\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223386 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-daemon-config\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223419 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-kubelet\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223439 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-hostroot\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223445 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-tmp-dir\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223472 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4rnq\" (UniqueName: \"kubernetes.io/projected/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-kube-api-access-z4rnq\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-system-cni-dir\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223500 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-os-release\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-os-release\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223602 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-hosts-file\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.223952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-netns\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-serviceca\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-etc-kubernetes\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224065 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5026e325-ff9f-4f0f-b706-8e97367bb7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5026e325-ff9f-4f0f-b706-8e97367bb7db-cnibin\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-host\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224175 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-run-multus-certs\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-cnibin\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-cni-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-cni-multus\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.224398 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.224478 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs podName:e8cbcbd3-2160-4238-8029-6d32911a0f6c nodeName:}" failed. No retries permitted until 2026-05-21 11:43:49.724460713 +0000 UTC m=+3.153391573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs") pod "network-metrics-daemon-55klh" (UID: "e8cbcbd3-2160-4238-8029-6d32911a0f6c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224585 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170f995d-960b-4f2c-ab53-c5897a6a27f4-cni-binary-copy\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-cni-bin\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.224743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-conf-dir\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.225451 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-daemon-config\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.225451 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.223558 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-hosts-file\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.225451 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224855 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-host-var-lib-kubelet\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.225451 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.224804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170f995d-960b-4f2c-ab53-c5897a6a27f4-multus-socket-dir-parent\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.225451 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.225088 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-tmp-dir\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.233012 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.232987 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9svsl\" (UniqueName: \"kubernetes.io/projected/e8cbcbd3-2160-4238-8029-6d32911a0f6c-kube-api-access-9svsl\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:49.233531 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.233227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s2zh\" (UniqueName: \"kubernetes.io/projected/b2eec013-9617-40a4-ac11-5e4eb5f17c0f-kube-api-access-4s2zh\") pod \"node-ca-cxw7j\" (UID: \"b2eec013-9617-40a4-ac11-5e4eb5f17c0f\") " pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.235676 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.235617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln4qv\" (UniqueName: \"kubernetes.io/projected/170f995d-960b-4f2c-ab53-c5897a6a27f4-kube-api-access-ln4qv\") pod \"multus-ksgjn\" (UID: \"170f995d-960b-4f2c-ab53-c5897a6a27f4\") " pod="openshift-multus/multus-ksgjn" May 21 11:43:49.235906 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.235884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv9nh\" (UniqueName: \"kubernetes.io/projected/5026e325-ff9f-4f0f-b706-8e97367bb7db-kube-api-access-cv9nh\") pod \"multus-additional-cni-plugins-lc944\" (UID: \"5026e325-ff9f-4f0f-b706-8e97367bb7db\") " pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.235957 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.235927 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4rnq\" (UniqueName: \"kubernetes.io/projected/5dfd9d49-f61c-4c0f-93bd-ae95abebb036-kube-api-access-z4rnq\") pod \"node-resolver-fs9s4\" (UID: \"5dfd9d49-f61c-4c0f-93bd-ae95abebb036\") " pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.306122 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.306079 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" May 21 11:43:49.313897 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.313861 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q92l2" May 21 11:43:49.322756 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.322721 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:43:49.328969 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.328654 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bf8nd" May 21 11:43:49.335603 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.335576 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" May 21 11:43:49.342310 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.342267 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cxw7j" May 21 11:43:49.351071 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.351042 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lc944" May 21 11:43:49.357832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.357811 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ksgjn" May 21 11:43:49.364681 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.364656 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fs9s4" May 21 11:43:49.728563 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.728489 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:49.728563 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:49.728543 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:49.728778 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.728636 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:49.728778 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.728663 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:43:49.728778 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.728687 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:43:49.728778 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.728700 2565 projected.go:194] Error preparing data for projected volume kube-api-access-2ltvs for pod openshift-network-diagnostics/network-check-target-ff7pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:49.728778 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.728689 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs podName:e8cbcbd3-2160-4238-8029-6d32911a0f6c nodeName:}" failed. No retries permitted until 2026-05-21 11:43:50.72867493 +0000 UTC m=+4.157605785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs") pod "network-metrics-daemon-55klh" (UID: "e8cbcbd3-2160-4238-8029-6d32911a0f6c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:49.728778 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:49.728777 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs podName:adbaf571-7f00-461b-81e0-25ee4580c0d9 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:50.728759479 +0000 UTC m=+4.157690327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ltvs" (UniqueName: "kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs") pod "network-check-target-ff7pn" (UID: "adbaf571-7f00-461b-81e0-25ee4580c0d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:49.948813 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:49.948608 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a920b11_b5a2_41b3_a6b5_2e8e82488e5e.slice/crio-d1f9599542ef2f79c4767c4342882bfc45ee07a93ea8ef362fe5764c98db143d WatchSource:0}: Error finding container d1f9599542ef2f79c4767c4342882bfc45ee07a93ea8ef362fe5764c98db143d: Status 404 returned error can't find the container with id d1f9599542ef2f79c4767c4342882bfc45ee07a93ea8ef362fe5764c98db143d May 21 11:43:49.949674 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:49.949651 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d349e0_5e56_4c99_892c_abc277e52a01.slice/crio-96d521aaa9f746cd95aac7f585a4556a1de55b77e300638bb6a6329d263a9c5b WatchSource:0}: Error finding container 96d521aaa9f746cd95aac7f585a4556a1de55b77e300638bb6a6329d263a9c5b: Status 404 returned error can't find the container with id 96d521aaa9f746cd95aac7f585a4556a1de55b77e300638bb6a6329d263a9c5b May 21 11:43:49.950806 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:49.950785 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2eec013_9617_40a4_ac11_5e4eb5f17c0f.slice/crio-2fe1511c63f51e42557b3953f882df7f8ff54ca6a1da2f529c81d78213d100ec WatchSource:0}: Error finding container 2fe1511c63f51e42557b3953f882df7f8ff54ca6a1da2f529c81d78213d100ec: Status 404 returned error can't find the container with id 2fe1511c63f51e42557b3953f882df7f8ff54ca6a1da2f529c81d78213d100ec May 21 11:43:49.952128 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:49.952094 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170f995d_960b_4f2c_ab53_c5897a6a27f4.slice/crio-259564474d397339a87f7c8860be58e825c575bd6567782457b88f336932c50c WatchSource:0}: Error finding container 259564474d397339a87f7c8860be58e825c575bd6567782457b88f336932c50c: Status 404 returned error can't find the container with id 259564474d397339a87f7c8860be58e825c575bd6567782457b88f336932c50c May 21 11:43:49.956001 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:49.955928 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dfd9d49_f61c_4c0f_93bd_ae95abebb036.slice/crio-c73cf2e895b855b7888146f73f82887b11258115e2940fb92a53cea82bba8b45 WatchSource:0}: Error finding container c73cf2e895b855b7888146f73f82887b11258115e2940fb92a53cea82bba8b45: Status 404 returned error can't find the container with id c73cf2e895b855b7888146f73f82887b11258115e2940fb92a53cea82bba8b45 May 21 11:43:49.959300 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:43:49.957330 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2166ec23_d8f9_47e3_9642_497cf6d70c52.slice/crio-5279f94819747daec8492d0204f546debb0aab2bb439b1825cbc6db5ad7b847f WatchSource:0}: Error finding container 5279f94819747daec8492d0204f546debb0aab2bb439b1825cbc6db5ad7b847f: Status 404 returned error can't find the container with id 5279f94819747daec8492d0204f546debb0aab2bb439b1825cbc6db5ad7b847f May 21 11:43:50.050832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.050798 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 11:38:48 +0000 UTC" deadline="2028-01-29 11:37:27.367980456 +0000 UTC" May 21 11:43:50.050832 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.050829 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14831h53m37.317154145s" May 21 11:43:50.168157 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.168121 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" event={"ID":"7b3377fb9a8b818b500586a2752a7122","Type":"ContainerStarted","Data":"8989e11b2a7f92e33e81babb01584a5891a24b957401ec13d6404f4116be6249"} May 21 11:43:50.170259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.170228 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bf8nd" event={"ID":"00dbc12c-57b3-4249-b56f-6290e1cea32b","Type":"ContainerStarted","Data":"f027f5233b43a22b0f69de4af964e755e22ab3493ec20c91a882eb54f2b7d681"} May 21 11:43:50.171575 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.171552 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fs9s4" event={"ID":"5dfd9d49-f61c-4c0f-93bd-ae95abebb036","Type":"ContainerStarted","Data":"c73cf2e895b855b7888146f73f82887b11258115e2940fb92a53cea82bba8b45"} May 21 11:43:50.172477 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.172439 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cxw7j" event={"ID":"b2eec013-9617-40a4-ac11-5e4eb5f17c0f","Type":"ContainerStarted","Data":"2fe1511c63f51e42557b3953f882df7f8ff54ca6a1da2f529c81d78213d100ec"} May 21 11:43:50.173463 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.173440 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" event={"ID":"f6d349e0-5e56-4c99-892c-abc277e52a01","Type":"ContainerStarted","Data":"96d521aaa9f746cd95aac7f585a4556a1de55b77e300638bb6a6329d263a9c5b"} May 21 11:43:50.174508 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.174482 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lc944" event={"ID":"5026e325-ff9f-4f0f-b706-8e97367bb7db","Type":"ContainerStarted","Data":"8fc890ae9dc3eb2d1229b5c787f76a1497444b1f7945f4c411fddc1646400292"} May 21 11:43:50.175417 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.175398 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"103eb4119114b2ca0625e70a430dd1273745384ffef7bf9ae3dd982598777d13"} May 21 11:43:50.176435 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.176406 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q92l2" event={"ID":"2166ec23-d8f9-47e3-9642-497cf6d70c52","Type":"ContainerStarted","Data":"5279f94819747daec8492d0204f546debb0aab2bb439b1825cbc6db5ad7b847f"} May 21 11:43:50.178858 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.178836 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ksgjn" event={"ID":"170f995d-960b-4f2c-ab53-c5897a6a27f4","Type":"ContainerStarted","Data":"259564474d397339a87f7c8860be58e825c575bd6567782457b88f336932c50c"} May 21 11:43:50.180636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.180616 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" event={"ID":"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e","Type":"ContainerStarted","Data":"d1f9599542ef2f79c4767c4342882bfc45ee07a93ea8ef362fe5764c98db143d"} May 21 11:43:50.183213 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.183168 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-255.ec2.internal" podStartSLOduration=2.183155093 podStartE2EDuration="2.183155093s" podCreationTimestamp="2026-05-21 11:43:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:43:50.18298639 +0000 UTC m=+3.611917256" watchObservedRunningTime="2026-05-21 11:43:50.183155093 +0000 UTC m=+3.612085961" May 21 11:43:50.737183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.736913 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:50.737183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:50.736979 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:50.737183 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:50.737139 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:50.737525 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:50.737219 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs podName:e8cbcbd3-2160-4238-8029-6d32911a0f6c nodeName:}" failed. No retries permitted until 2026-05-21 11:43:52.7371965 +0000 UTC m=+6.166127349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs") pod "network-metrics-daemon-55klh" (UID: "e8cbcbd3-2160-4238-8029-6d32911a0f6c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:50.737592 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:50.737146 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:43:50.737645 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:50.737605 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:43:50.737645 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:50.737621 2565 projected.go:194] Error preparing data for projected volume kube-api-access-2ltvs for pod openshift-network-diagnostics/network-check-target-ff7pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:50.737742 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:50.737667 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs podName:adbaf571-7f00-461b-81e0-25ee4580c0d9 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:52.737652719 +0000 UTC m=+6.166583566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ltvs" (UniqueName: "kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs") pod "network-check-target-ff7pn" (UID: "adbaf571-7f00-461b-81e0-25ee4580c0d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:51.159735 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:51.159656 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:51.160252 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:51.159811 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:43:51.160252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:51.159957 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:51.160252 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:51.160029 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:43:51.204874 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:51.204834 2565 generic.go:358] "Generic (PLEG): container finished" podID="4310f6241c908513c7aaf2db6a147e52" containerID="90286ecc13d2d98f4f34f2f0ee3bf535a2388a58b4cffd8bda49204d28775659" exitCode=0 May 21 11:43:51.205494 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:51.205440 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" event={"ID":"4310f6241c908513c7aaf2db6a147e52","Type":"ContainerDied","Data":"90286ecc13d2d98f4f34f2f0ee3bf535a2388a58b4cffd8bda49204d28775659"} May 21 11:43:52.252350 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:52.252162 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" event={"ID":"4310f6241c908513c7aaf2db6a147e52","Type":"ContainerStarted","Data":"dac265bccdfdf3ee6b16e1df0ccf3f8d135fbdde4b8c83c023171a313f353410"} May 21 11:43:52.756352 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:52.756313 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:52.756579 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:52.756379 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:52.756579 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:52.756529 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:43:52.756579 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:52.756546 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:43:52.756579 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:52.756562 2565 projected.go:194] Error preparing data for projected volume kube-api-access-2ltvs for pod openshift-network-diagnostics/network-check-target-ff7pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:52.756846 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:52.756617 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs podName:adbaf571-7f00-461b-81e0-25ee4580c0d9 nodeName:}" failed. No retries permitted until 2026-05-21 11:43:56.756599716 +0000 UTC m=+10.185530576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ltvs" (UniqueName: "kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs") pod "network-check-target-ff7pn" (UID: "adbaf571-7f00-461b-81e0-25ee4580c0d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:52.757032 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:52.757014 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:52.757101 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:52.757069 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs podName:e8cbcbd3-2160-4238-8029-6d32911a0f6c nodeName:}" failed. No retries permitted until 2026-05-21 11:43:56.757052458 +0000 UTC m=+10.185983307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs") pod "network-metrics-daemon-55klh" (UID: "e8cbcbd3-2160-4238-8029-6d32911a0f6c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:53.166747 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:53.165320 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:53.166747 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:53.165505 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:43:53.166747 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:53.165964 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:53.166747 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:53.166114 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:43:55.156812 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:55.156775 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:55.157216 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:55.156904 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:43:55.157325 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:55.157218 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:55.157325 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:55.157309 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:43:56.793866 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:56.793829 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:56.794289 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:56.793880 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:56.794289 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:56.793961 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:56.794289 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:56.793973 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:43:56.794289 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:56.793991 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:43:56.794289 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:56.794000 2565 projected.go:194] Error preparing data for projected volume kube-api-access-2ltvs for pod openshift-network-diagnostics/network-check-target-ff7pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:56.794289 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:56.794042 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs podName:e8cbcbd3-2160-4238-8029-6d32911a0f6c nodeName:}" failed. No retries permitted until 2026-05-21 11:44:04.794021421 +0000 UTC m=+18.222952282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs") pod "network-metrics-daemon-55klh" (UID: "e8cbcbd3-2160-4238-8029-6d32911a0f6c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:43:56.794289 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:56.794064 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs podName:adbaf571-7f00-461b-81e0-25ee4580c0d9 nodeName:}" failed. No retries permitted until 2026-05-21 11:44:04.794053602 +0000 UTC m=+18.222984452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ltvs" (UniqueName: "kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs") pod "network-check-target-ff7pn" (UID: "adbaf571-7f00-461b-81e0-25ee4580c0d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:43:57.162091 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:57.161919 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:57.162091 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:57.161952 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:57.162091 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:57.162045 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:43:57.162368 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:57.162125 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:43:59.156764 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:59.156726 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:43:59.157232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:43:59.156767 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:43:59.157232 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:59.156853 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:43:59.157360 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:43:59.157310 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:01.156944 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:01.156910 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:01.157425 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:01.157049 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:01.157425 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:01.157087 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:01.157425 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:01.157177 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:03.156571 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:03.156531 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:03.157071 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:03.156542 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:03.157071 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:03.156674 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:03.157071 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:03.156795 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:04.850673 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:04.850342 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:04.850673 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:04.850408 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:04.850673 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:04.850528 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:44:04.850673 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:04.850563 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:44:04.850673 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:04.850583 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:44:04.850673 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:04.850598 2565 projected.go:194] Error preparing data for projected volume kube-api-access-2ltvs for pod openshift-network-diagnostics/network-check-target-ff7pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:44:04.850673 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:04.850609 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs podName:e8cbcbd3-2160-4238-8029-6d32911a0f6c nodeName:}" failed. No retries permitted until 2026-05-21 11:44:20.850587251 +0000 UTC m=+34.279518099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs") pod "network-metrics-daemon-55klh" (UID: "e8cbcbd3-2160-4238-8029-6d32911a0f6c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:44:04.850673 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:04.850645 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs podName:adbaf571-7f00-461b-81e0-25ee4580c0d9 nodeName:}" failed. No retries permitted until 2026-05-21 11:44:20.8506265 +0000 UTC m=+34.279557345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ltvs" (UniqueName: "kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs") pod "network-check-target-ff7pn" (UID: "adbaf571-7f00-461b-81e0-25ee4580c0d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:44:05.156691 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:05.156610 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:05.156829 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:05.156745 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:05.156829 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:05.156785 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:05.156944 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:05.156860 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:07.157699 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:07.157660 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:07.158228 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:07.157770 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:07.158228 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:07.157845 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:07.158228 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:07.157933 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:09.156804 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.156447 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:09.157762 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.156521 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:09.157762 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:09.156889 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:09.157762 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:09.156958 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:09.281973 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.281936 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bf8nd" event={"ID":"00dbc12c-57b3-4249-b56f-6290e1cea32b","Type":"ContainerStarted","Data":"9919eb894fa6ec0048235de048e097c2b5e9c17755cdc660b7e94827c4db2ebe"} May 21 11:44:09.283330 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.283302 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fs9s4" event={"ID":"5dfd9d49-f61c-4c0f-93bd-ae95abebb036","Type":"ContainerStarted","Data":"1526693be6e41aea3ca52790bd702c0aad9c55f1f28f41c4493f93e77bb3a27e"} May 21 11:44:09.284926 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.284906 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cxw7j" event={"ID":"b2eec013-9617-40a4-ac11-5e4eb5f17c0f","Type":"ContainerStarted","Data":"862fecc7ddc8e23b2194711cfc25f808f032197a8245b87bc9caa047d8135e97"} May 21 11:44:09.286185 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.286165 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" event={"ID":"f6d349e0-5e56-4c99-892c-abc277e52a01","Type":"ContainerStarted","Data":"91395fee4d00332faad65dea722ea439201dfe4fb1557b8c00f6567b028ca086"} May 21 11:44:09.287566 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.287547 2565 generic.go:358] "Generic (PLEG): container finished" podID="5026e325-ff9f-4f0f-b706-8e97367bb7db" containerID="41dbe0ef6b13250df09c1468dd28aac43ea4e2e96cffea64d8256c8f52dfe8a0" exitCode=0 May 21 11:44:09.287660 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.287604 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lc944" event={"ID":"5026e325-ff9f-4f0f-b706-8e97367bb7db","Type":"ContainerDied","Data":"41dbe0ef6b13250df09c1468dd28aac43ea4e2e96cffea64d8256c8f52dfe8a0"} May 21 11:44:09.290056 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.290040 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:44:09.290331 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.290311 2565 generic.go:358] "Generic (PLEG): container finished" podID="ae9abcf2-9e8b-4104-aace-509e4aeed93b" containerID="d83bc92526c73f330d9c6478203653183c2653ad8a77d144ae7d8c744eb2b8bd" exitCode=1 May 21 11:44:09.290406 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.290381 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"aa0ac7711385a122b84baf1c2394d031a0b4880e6398ea71690ca4df3ad1bff1"} May 21 11:44:09.290448 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.290408 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"14df9037c981158baabaebaeaa31d994edf3d2dac6f60e4045681c75938954e6"} May 21 11:44:09.290448 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.290425 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"3e4b4483c09b7b2c5168f0456d3ccdca681f43c7399d347797b2105339e2de05"} May 21 11:44:09.290448 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.290438 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"86b83f28d21377fefa2db7005e09faa95d61e502c8eac08d80492a217112136b"} May 21 11:44:09.290551 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.290450 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerDied","Data":"d83bc92526c73f330d9c6478203653183c2653ad8a77d144ae7d8c744eb2b8bd"} May 21 11:44:09.290551 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.290464 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"20ab861f35e72562fa0c8f232926b0f0bfcf634636b1f291d6007541acbb821f"} May 21 11:44:09.291679 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.291661 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ksgjn" event={"ID":"170f995d-960b-4f2c-ab53-c5897a6a27f4","Type":"ContainerStarted","Data":"ffaf74b6ef32b573d7ddd31cd087669238a09ec61184e8ac9e7f1159b33bb8cf"} May 21 11:44:09.292911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.292893 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" event={"ID":"6a920b11-b5a2-41b3-a6b5-2e8e82488e5e","Type":"ContainerStarted","Data":"e499f1a3110486d667c93640495b07311f56b7d5d97c6566b1ba4a79fd6be10b"} May 21 11:44:09.297095 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.297063 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-255.ec2.internal" podStartSLOduration=21.297054143 podStartE2EDuration="21.297054143s" podCreationTimestamp="2026-05-21 11:43:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:43:52.269870269 +0000 UTC m=+5.698801137" watchObservedRunningTime="2026-05-21 11:44:09.297054143 +0000 UTC m=+22.725985009" May 21 11:44:09.297525 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.297500 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bf8nd" podStartSLOduration=4.019226611 podStartE2EDuration="22.297493361s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.96320745 +0000 UTC m=+3.392138297" lastFinishedPulling="2026-05-21 11:44:08.241474203 +0000 UTC m=+21.670405047" observedRunningTime="2026-05-21 11:44:09.297126509 +0000 UTC m=+22.726057376" watchObservedRunningTime="2026-05-21 11:44:09.297493361 +0000 UTC m=+22.726424244" May 21 11:44:09.315296 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.315243 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-ksgjn" podStartSLOduration=3.989631473 podStartE2EDuration="22.315232765s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.954461127 +0000 UTC m=+3.383391973" lastFinishedPulling="2026-05-21 11:44:08.280062419 +0000 UTC m=+21.708993265" observedRunningTime="2026-05-21 11:44:09.314588311 +0000 UTC m=+22.743519177" watchObservedRunningTime="2026-05-21 11:44:09.315232765 +0000 UTC m=+22.744163633" May 21 11:44:09.350829 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.350762 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fs9s4" podStartSLOduration=4.068858723 podStartE2EDuration="22.350750884s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.959695591 +0000 UTC m=+3.388626437" lastFinishedPulling="2026-05-21 11:44:08.241587746 +0000 UTC m=+21.670518598" observedRunningTime="2026-05-21 11:44:09.350627373 +0000 UTC m=+22.779558241" watchObservedRunningTime="2026-05-21 11:44:09.350750884 +0000 UTC m=+22.779681750" May 21 11:44:09.366664 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.366630 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hbvbz" podStartSLOduration=4.044263309 podStartE2EDuration="22.36662005s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.950792935 +0000 UTC m=+3.379723786" lastFinishedPulling="2026-05-21 11:44:08.273149681 +0000 UTC m=+21.702080527" observedRunningTime="2026-05-21 11:44:09.366125291 +0000 UTC m=+22.795056162" watchObservedRunningTime="2026-05-21 11:44:09.36662005 +0000 UTC m=+22.795550916" May 21 11:44:09.381127 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.381091 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cxw7j" podStartSLOduration=8.879519586 podStartE2EDuration="22.381080408s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.953496696 +0000 UTC m=+3.382427543" lastFinishedPulling="2026-05-21 11:44:03.455057513 +0000 UTC m=+16.883988365" observedRunningTime="2026-05-21 11:44:09.380877717 +0000 UTC m=+22.809808595" watchObservedRunningTime="2026-05-21 11:44:09.381080408 +0000 UTC m=+22.810011276" May 21 11:44:09.392100 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.392082 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bf8nd" May 21 11:44:09.392551 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.392537 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bf8nd" May 21 11:44:09.574386 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:09.574362 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 11:44:10.081201 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:10.081033 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T11:44:09.574382422Z","UUID":"5857413e-d2b9-408a-ad6a-42c4737e43f2","Handler":null,"Name":"","Endpoint":""} May 21 11:44:10.082939 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:10.082916 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 11:44:10.083069 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:10.082947 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 11:44:10.297575 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:10.297529 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" event={"ID":"f6d349e0-5e56-4c99-892c-abc277e52a01","Type":"ContainerStarted","Data":"c599cdbd00e7db2bba587e64d6aa2364a31a4941ac1c3d56af3fccef665263a5"} May 21 11:44:10.300188 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:10.300158 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q92l2" event={"ID":"2166ec23-d8f9-47e3-9642-497cf6d70c52","Type":"ContainerStarted","Data":"4fa4ab6e587f2a9f7b61ccc329eee5a624c4030c9feaebc7c1abc12e4c7fea8a"} May 21 11:44:10.301156 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:10.301134 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bf8nd" May 21 11:44:10.301626 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:10.301595 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bf8nd" May 21 11:44:10.314895 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:10.314840 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q92l2" podStartSLOduration=5.004700188 podStartE2EDuration="23.314827479s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.962669247 +0000 UTC m=+3.391600097" lastFinishedPulling="2026-05-21 11:44:08.272796543 +0000 UTC m=+21.701727388" observedRunningTime="2026-05-21 11:44:10.314592675 +0000 UTC m=+23.743523546" watchObservedRunningTime="2026-05-21 11:44:10.314827479 +0000 UTC m=+23.743758346" May 21 11:44:11.156391 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:11.156168 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:11.156508 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:11.156226 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:11.156569 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:11.156501 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:11.156569 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:11.156553 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:11.303219 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:11.303197 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:44:11.303643 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:11.303578 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"fca2b31d103c909084cf0b691dbe81f36a4cb083f1ed9360342c38c605d14efd"} May 21 11:44:11.305214 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:11.305186 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" event={"ID":"f6d349e0-5e56-4c99-892c-abc277e52a01","Type":"ContainerStarted","Data":"1b37996a1e82911c303a87a27ca6d51e2a2effb80b91b507012be360e25e5071"} May 21 11:44:13.157138 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:13.157098 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:13.157778 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:13.157234 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:13.157838 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:13.157813 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:13.157945 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:13.157924 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:15.157039 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.156841 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:15.157509 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.156841 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:15.157509 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:15.157126 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:15.157509 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:15.157194 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:15.313660 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.313629 2565 generic.go:358] "Generic (PLEG): container finished" podID="5026e325-ff9f-4f0f-b706-8e97367bb7db" containerID="ad499e29e8c7b92aca3449ef0e330e4fd833bcf270ea3e88e05841023d4960f7" exitCode=0 May 21 11:44:15.313852 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.313709 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lc944" event={"ID":"5026e325-ff9f-4f0f-b706-8e97367bb7db","Type":"ContainerDied","Data":"ad499e29e8c7b92aca3449ef0e330e4fd833bcf270ea3e88e05841023d4960f7"} May 21 11:44:15.316640 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.316618 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:44:15.316913 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.316895 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"eaefca586e2779f4ff62ff94bafd6a2ac8bb8238ffed0add0f178791bd83f425"} May 21 11:44:15.317261 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.317242 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:44:15.317419 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.317396 2565 scope.go:117] "RemoveContainer" containerID="d83bc92526c73f330d9c6478203653183c2653ad8a77d144ae7d8c744eb2b8bd" May 21 11:44:15.334078 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.334058 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:44:15.342325 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:15.340727 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6xfk" podStartSLOduration=7.491943213 podStartE2EDuration="28.340669869s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.95168203 +0000 UTC m=+3.380612875" lastFinishedPulling="2026-05-21 11:44:10.800408672 +0000 UTC m=+24.229339531" observedRunningTime="2026-05-21 11:44:11.324587705 +0000 UTC m=+24.753518572" watchObservedRunningTime="2026-05-21 11:44:15.340669869 +0000 UTC m=+28.769600735" May 21 11:44:16.321149 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.320973 2565 generic.go:358] "Generic (PLEG): container finished" podID="5026e325-ff9f-4f0f-b706-8e97367bb7db" containerID="d25c5ccedae574a4d6f74e2e390458075a56867eb44b4ae0cf1dc4bee8c76f44" exitCode=0 May 21 11:44:16.321567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.321034 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lc944" event={"ID":"5026e325-ff9f-4f0f-b706-8e97367bb7db","Type":"ContainerDied","Data":"d25c5ccedae574a4d6f74e2e390458075a56867eb44b4ae0cf1dc4bee8c76f44"} May 21 11:44:16.324694 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.324663 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:44:16.325029 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.325005 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" event={"ID":"ae9abcf2-9e8b-4104-aace-509e4aeed93b","Type":"ContainerStarted","Data":"987b7afbca038bb096ece59fcebb9c85eb2c2175885dc1d8a7a7b3e0fc7a22dc"} May 21 11:44:16.325380 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.325341 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:44:16.325380 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.325379 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:44:16.341541 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.341520 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:44:16.369245 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.369200 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" podStartSLOduration=11.003036477 podStartE2EDuration="29.369188873s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.962924613 +0000 UTC m=+3.391855462" lastFinishedPulling="2026-05-21 11:44:08.329077006 +0000 UTC m=+21.758007858" observedRunningTime="2026-05-21 11:44:16.36842444 +0000 UTC m=+29.797355310" watchObservedRunningTime="2026-05-21 11:44:16.369188873 +0000 UTC m=+29.798119739" May 21 11:44:16.506424 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.506356 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ff7pn"] May 21 11:44:16.506550 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.506472 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:16.506587 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:16.506551 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:16.509612 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.509592 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-55klh"] May 21 11:44:16.509688 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:16.509676 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:16.509792 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:16.509767 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:17.329059 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:17.329027 2565 generic.go:358] "Generic (PLEG): container finished" podID="5026e325-ff9f-4f0f-b706-8e97367bb7db" containerID="fb5065566f1f980c84ea3c3f389d75b0df6c83d00c9ac3b6b10e9bca7bb1d0c6" exitCode=0 May 21 11:44:17.329511 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:17.329113 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lc944" event={"ID":"5026e325-ff9f-4f0f-b706-8e97367bb7db","Type":"ContainerDied","Data":"fb5065566f1f980c84ea3c3f389d75b0df6c83d00c9ac3b6b10e9bca7bb1d0c6"} May 21 11:44:18.156552 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:18.156511 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:18.156730 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:18.156516 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:18.156730 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:18.156650 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:18.156730 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:18.156705 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:20.157067 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.157023 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:20.157718 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.157023 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:20.157718 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:20.157170 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff7pn" podUID="adbaf571-7f00-461b-81e0-25ee4580c0d9" May 21 11:44:20.157718 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:20.157244 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55klh" podUID="e8cbcbd3-2160-4238-8029-6d32911a0f6c" May 21 11:44:20.854625 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.854594 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-255.ec2.internal" event="NodeReady" May 21 11:44:20.854791 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.854740 2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 11:44:20.878744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.878707 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:20.878928 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.878766 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:20.878928 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:20.878859 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:44:20.878928 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:20.878904 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 11:44:20.878928 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:20.878921 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 11:44:20.879107 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:20.878936 2565 projected.go:194] Error preparing data for projected volume kube-api-access-2ltvs for pod openshift-network-diagnostics/network-check-target-ff7pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:44:20.879107 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:20.878924 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs podName:e8cbcbd3-2160-4238-8029-6d32911a0f6c nodeName:}" failed. No retries permitted until 2026-05-21 11:44:52.878905732 +0000 UTC m=+66.307836592 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs") pod "network-metrics-daemon-55klh" (UID: "e8cbcbd3-2160-4238-8029-6d32911a0f6c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 11:44:20.879107 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:20.878995 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs podName:adbaf571-7f00-461b-81e0-25ee4580c0d9 nodeName:}" failed. No retries permitted until 2026-05-21 11:44:52.878977782 +0000 UTC m=+66.307908633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ltvs" (UniqueName: "kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs") pod "network-check-target-ff7pn" (UID: "adbaf571-7f00-461b-81e0-25ee4580c0d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 11:44:20.900439 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.900398 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vc87h"] May 21 11:44:20.916144 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.916105 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vc87h"] May 21 11:44:20.916338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.916205 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:20.918819 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.918791 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 11:44:20.918819 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.918817 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 11:44:20.919007 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.918833 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 11:44:20.919190 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:20.919175 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cwzz8\"" May 21 11:44:21.001478 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.001439 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5kkp2"] May 21 11:44:21.012860 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.012825 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.015543 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.015516 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 11:44:21.015705 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.015650 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 11:44:21.015705 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.015676 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5kkp2"] May 21 11:44:21.015981 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.015825 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6x8vn\"" May 21 11:44:21.080265 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.080225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zxwx\" (UniqueName: \"kubernetes.io/projected/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-kube-api-access-6zxwx\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:21.080480 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.080337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:21.181065 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.181027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa9ae98-31db-45b3-9c64-90f571f92e8b-config-volume\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.181065 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.181067 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:21.181797 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.181097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67c22\" (UniqueName: \"kubernetes.io/projected/7fa9ae98-31db-45b3-9c64-90f571f92e8b-kube-api-access-67c22\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.181797 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.181174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fa9ae98-31db-45b3-9c64-90f571f92e8b-tmp-dir\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.181797 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.181203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.181797 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:21.181219 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:44:21.181797 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.181245 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zxwx\" (UniqueName: \"kubernetes.io/projected/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-kube-api-access-6zxwx\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:21.181797 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:21.181302 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert podName:fe84da0a-c03f-4d28-9d56-fdd9844b31bf nodeName:}" failed. No retries permitted until 2026-05-21 11:44:21.681284264 +0000 UTC m=+35.110215123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert") pod "ingress-canary-vc87h" (UID: "fe84da0a-c03f-4d28-9d56-fdd9844b31bf") : secret "canary-serving-cert" not found May 21 11:44:21.194751 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.194717 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zxwx\" (UniqueName: \"kubernetes.io/projected/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-kube-api-access-6zxwx\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:21.281827 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.281788 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fa9ae98-31db-45b3-9c64-90f571f92e8b-tmp-dir\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.281996 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.281835 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.281996 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.281903 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa9ae98-31db-45b3-9c64-90f571f92e8b-config-volume\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.282110 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:21.282016 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:44:21.282110 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.282066 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67c22\" (UniqueName: \"kubernetes.io/projected/7fa9ae98-31db-45b3-9c64-90f571f92e8b-kube-api-access-67c22\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.282110 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:21.282080 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls podName:7fa9ae98-31db-45b3-9c64-90f571f92e8b nodeName:}" failed. No retries permitted until 2026-05-21 11:44:21.78206463 +0000 UTC m=+35.210995480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls") pod "dns-default-5kkp2" (UID: "7fa9ae98-31db-45b3-9c64-90f571f92e8b") : secret "dns-default-metrics-tls" not found May 21 11:44:21.282110 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.282089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fa9ae98-31db-45b3-9c64-90f571f92e8b-tmp-dir\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.282518 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.282499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa9ae98-31db-45b3-9c64-90f571f92e8b-config-volume\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.291663 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.291640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67c22\" (UniqueName: \"kubernetes.io/projected/7fa9ae98-31db-45b3-9c64-90f571f92e8b-kube-api-access-67c22\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.685160 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.684888 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:21.685383 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:21.685070 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:44:21.685383 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:21.685295 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert podName:fe84da0a-c03f-4d28-9d56-fdd9844b31bf nodeName:}" failed. No retries permitted until 2026-05-21 11:44:22.685256989 +0000 UTC m=+36.114187837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert") pod "ingress-canary-vc87h" (UID: "fe84da0a-c03f-4d28-9d56-fdd9844b31bf") : secret "canary-serving-cert" not found May 21 11:44:21.785972 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:21.785926 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:21.786162 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:21.786096 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:44:21.786224 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:21.786176 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls podName:7fa9ae98-31db-45b3-9c64-90f571f92e8b nodeName:}" failed. No retries permitted until 2026-05-21 11:44:22.786153988 +0000 UTC m=+36.215084852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls") pod "dns-default-5kkp2" (UID: "7fa9ae98-31db-45b3-9c64-90f571f92e8b") : secret "dns-default-metrics-tls" not found May 21 11:44:22.156579 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.156535 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:22.156782 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.156551 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:22.159812 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.159791 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 11:44:22.160933 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.160912 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 11:44:22.160933 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.160936 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ds8sh\"" May 21 11:44:22.160933 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.160950 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 11:44:22.161251 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.160958 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p6q78\"" May 21 11:44:22.693119 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.693079 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:22.693628 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:22.693254 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:44:22.693628 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:22.693390 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert podName:fe84da0a-c03f-4d28-9d56-fdd9844b31bf nodeName:}" failed. No retries permitted until 2026-05-21 11:44:24.693358278 +0000 UTC m=+38.122289136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert") pod "ingress-canary-vc87h" (UID: "fe84da0a-c03f-4d28-9d56-fdd9844b31bf") : secret "canary-serving-cert" not found May 21 11:44:22.793479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:22.793438 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:22.793661 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:22.793584 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:44:22.793661 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:22.793656 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls podName:7fa9ae98-31db-45b3-9c64-90f571f92e8b nodeName:}" failed. No retries permitted until 2026-05-21 11:44:24.793639437 +0000 UTC m=+38.222570296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls") pod "dns-default-5kkp2" (UID: "7fa9ae98-31db-45b3-9c64-90f571f92e8b") : secret "dns-default-metrics-tls" not found May 21 11:44:24.344262 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:24.344227 2565 generic.go:358] "Generic (PLEG): container finished" podID="5026e325-ff9f-4f0f-b706-8e97367bb7db" containerID="a5db29903aeae3f2767dd62b289846b810ebc691c57bddd188ba050c0330597b" exitCode=0 May 21 11:44:24.344640 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:24.344314 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lc944" event={"ID":"5026e325-ff9f-4f0f-b706-8e97367bb7db","Type":"ContainerDied","Data":"a5db29903aeae3f2767dd62b289846b810ebc691c57bddd188ba050c0330597b"} May 21 11:44:24.708061 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:24.707967 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:24.708213 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:24.708103 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:44:24.708213 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:24.708168 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert podName:fe84da0a-c03f-4d28-9d56-fdd9844b31bf nodeName:}" failed. No retries permitted until 2026-05-21 11:44:28.708147836 +0000 UTC m=+42.137078681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert") pod "ingress-canary-vc87h" (UID: "fe84da0a-c03f-4d28-9d56-fdd9844b31bf") : secret "canary-serving-cert" not found May 21 11:44:24.809007 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:24.808974 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:24.809182 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:24.809129 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:44:24.809223 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:24.809198 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls podName:7fa9ae98-31db-45b3-9c64-90f571f92e8b nodeName:}" failed. No retries permitted until 2026-05-21 11:44:28.809182458 +0000 UTC m=+42.238113303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls") pod "dns-default-5kkp2" (UID: "7fa9ae98-31db-45b3-9c64-90f571f92e8b") : secret "dns-default-metrics-tls" not found May 21 11:44:25.348392 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:25.348353 2565 generic.go:358] "Generic (PLEG): container finished" podID="5026e325-ff9f-4f0f-b706-8e97367bb7db" containerID="bc927d03b9f703349bd38c9c75f26ec6ea56446f05153a10b07f573831045503" exitCode=0 May 21 11:44:25.348741 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:25.348403 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lc944" event={"ID":"5026e325-ff9f-4f0f-b706-8e97367bb7db","Type":"ContainerDied","Data":"bc927d03b9f703349bd38c9c75f26ec6ea56446f05153a10b07f573831045503"} May 21 11:44:26.353028 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:26.352992 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lc944" event={"ID":"5026e325-ff9f-4f0f-b706-8e97367bb7db","Type":"ContainerStarted","Data":"4d4a39ae62c5858fa7a2d81f91bf98a904173dd225c30b889d9874b2c8b1b516"} May 21 11:44:26.378476 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:26.378416 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lc944" podStartSLOduration=5.501183543 podStartE2EDuration="39.37840001s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:43:49.96500745 +0000 UTC m=+3.393938308" lastFinishedPulling="2026-05-21 11:44:23.842223925 +0000 UTC m=+37.271154775" observedRunningTime="2026-05-21 11:44:26.37698176 +0000 UTC m=+39.805912628" watchObservedRunningTime="2026-05-21 11:44:26.37840001 +0000 UTC m=+39.807330879" May 21 11:44:28.735825 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:28.735787 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:28.736356 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:28.735967 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:44:28.736356 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:28.736050 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert podName:fe84da0a-c03f-4d28-9d56-fdd9844b31bf nodeName:}" failed. No retries permitted until 2026-05-21 11:44:36.736026767 +0000 UTC m=+50.164957630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert") pod "ingress-canary-vc87h" (UID: "fe84da0a-c03f-4d28-9d56-fdd9844b31bf") : secret "canary-serving-cert" not found May 21 11:44:28.836357 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:28.836318 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:28.836516 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:28.836453 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:44:28.836516 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:28.836507 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls podName:7fa9ae98-31db-45b3-9c64-90f571f92e8b nodeName:}" failed. No retries permitted until 2026-05-21 11:44:36.836493796 +0000 UTC m=+50.265424641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls") pod "dns-default-5kkp2" (UID: "7fa9ae98-31db-45b3-9c64-90f571f92e8b") : secret "dns-default-metrics-tls" not found May 21 11:44:36.792303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:36.792241 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:36.792702 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:36.792392 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:44:36.792702 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:36.792465 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert podName:fe84da0a-c03f-4d28-9d56-fdd9844b31bf nodeName:}" failed. No retries permitted until 2026-05-21 11:44:52.792446445 +0000 UTC m=+66.221377295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert") pod "ingress-canary-vc87h" (UID: "fe84da0a-c03f-4d28-9d56-fdd9844b31bf") : secret "canary-serving-cert" not found May 21 11:44:36.892863 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:36.892826 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:36.893027 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:36.892976 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:44:36.893070 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:36.893036 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls podName:7fa9ae98-31db-45b3-9c64-90f571f92e8b nodeName:}" failed. No retries permitted until 2026-05-21 11:44:52.89301923 +0000 UTC m=+66.321950095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls") pod "dns-default-5kkp2" (UID: "7fa9ae98-31db-45b3-9c64-90f571f92e8b") : secret "dns-default-metrics-tls" not found May 21 11:44:48.341711 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:48.341679 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6mf9" May 21 11:44:52.808677 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:52.808633 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:44:52.809147 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:52.808802 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:44:52.809147 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:52.808887 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert podName:fe84da0a-c03f-4d28-9d56-fdd9844b31bf nodeName:}" failed. No retries permitted until 2026-05-21 11:45:24.80886718 +0000 UTC m=+98.237798040 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert") pod "ingress-canary-vc87h" (UID: "fe84da0a-c03f-4d28-9d56-fdd9844b31bf") : secret "canary-serving-cert" not found May 21 11:44:52.908946 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:52.908907 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:44:52.909108 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:52.908954 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:44:52.909108 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:52.908989 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:52.909108 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:52.909049 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:44:52.909260 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:52.909124 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls podName:7fa9ae98-31db-45b3-9c64-90f571f92e8b nodeName:}" failed. No retries permitted until 2026-05-21 11:45:24.909104994 +0000 UTC m=+98.338035839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls") pod "dns-default-5kkp2" (UID: "7fa9ae98-31db-45b3-9c64-90f571f92e8b") : secret "dns-default-metrics-tls" not found May 21 11:44:52.912129 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:52.912109 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 11:44:52.912219 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:52.912145 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 11:44:52.919755 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:52.919732 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 11:44:52.919832 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:44:52.919815 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs podName:e8cbcbd3-2160-4238-8029-6d32911a0f6c nodeName:}" failed. No retries permitted until 2026-05-21 11:45:56.919792906 +0000 UTC m=+130.348723753 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs") pod "network-metrics-daemon-55klh" (UID: "e8cbcbd3-2160-4238-8029-6d32911a0f6c") : secret "metrics-daemon-secret" not found May 21 11:44:52.922036 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:52.922020 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 11:44:52.933601 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:52.933574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ltvs\" (UniqueName: \"kubernetes.io/projected/adbaf571-7f00-461b-81e0-25ee4580c0d9-kube-api-access-2ltvs\") pod \"network-check-target-ff7pn\" (UID: \"adbaf571-7f00-461b-81e0-25ee4580c0d9\") " pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:53.075843 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:53.075818 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p6q78\"" May 21 11:44:53.083054 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:53.083029 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:53.221897 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:53.221866 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ff7pn"] May 21 11:44:53.226389 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:44:53.226358 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbaf571_7f00_461b_81e0_25ee4580c0d9.slice/crio-9d56adbf9e108a531375af5db6d7462f8cbf2b3ec8c7f6edc4412c615d3c77ae WatchSource:0}: Error finding container 9d56adbf9e108a531375af5db6d7462f8cbf2b3ec8c7f6edc4412c615d3c77ae: Status 404 returned error can't find the container with id 9d56adbf9e108a531375af5db6d7462f8cbf2b3ec8c7f6edc4412c615d3c77ae May 21 11:44:53.403513 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:53.403413 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ff7pn" event={"ID":"adbaf571-7f00-461b-81e0-25ee4580c0d9","Type":"ContainerStarted","Data":"9d56adbf9e108a531375af5db6d7462f8cbf2b3ec8c7f6edc4412c615d3c77ae"} May 21 11:44:56.410441 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:56.410404 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ff7pn" event={"ID":"adbaf571-7f00-461b-81e0-25ee4580c0d9","Type":"ContainerStarted","Data":"fbc9178ee4e1d3b5193e3f79c9d72746bbe515259edad88a17d777aa1d1ff761"} May 21 11:44:56.410834 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:56.410545 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:44:56.426221 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:44:56.426167 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ff7pn" podStartSLOduration=66.640451713 podStartE2EDuration="1m9.426153155s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:44:53.228044858 +0000 UTC m=+66.656975703" lastFinishedPulling="2026-05-21 11:44:56.013746291 +0000 UTC m=+69.442677145" observedRunningTime="2026-05-21 11:44:56.425574689 +0000 UTC m=+69.854505557" watchObservedRunningTime="2026-05-21 11:44:56.426153155 +0000 UTC m=+69.855084021" May 21 11:45:23.109868 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.109834 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2"] May 21 11:45:23.114002 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.113984 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.116412 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.116380 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995"] May 21 11:45:23.117089 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.117067 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 11:45:23.117193 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.117106 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 11:45:23.118614 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.118597 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m84rm\"" May 21 11:45:23.118710 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.118644 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 11:45:23.118769 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.118739 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 11:45:23.119234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.119218 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4"] May 21 11:45:23.119391 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.119377 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:23.121837 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.121818 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 11:45:23.121913 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.121888 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zg9v2"] May 21 11:45:23.122080 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.122061 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4" May 21 11:45:23.122155 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.122090 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 11:45:23.122815 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.122749 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 11:45:23.123263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.123243 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zhtml\"" May 21 11:45:23.127550 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.127530 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6dtqq\"" May 21 11:45:23.128513 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.128490 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 11:45:23.128943 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.128893 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 11:45:23.129960 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.129926 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2"] May 21 11:45:23.129960 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.129959 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4"] May 21 11:45:23.130093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.130070 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.130411 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.130384 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995"] May 21 11:45:23.132405 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.132375 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zg9v2"] May 21 11:45:23.132538 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.132470 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 11:45:23.132621 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.132555 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 11:45:23.133067 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.133041 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 11:45:23.133312 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.133100 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 11:45:23.133312 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.133194 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xpjfm\"" May 21 11:45:23.139508 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.139484 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 11:45:23.213657 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.213622 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8lzhv"] May 21 11:45:23.216403 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dae388d-4cf0-4fd4-868f-f8890245f60f-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.216537 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dae388d-4cf0-4fd4-868f-f8890245f60f-tmp\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.216537 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dae388d-4cf0-4fd4-868f-f8890245f60f-serving-cert\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.216537 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.216537 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dae388d-4cf0-4fd4-868f-f8890245f60f-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.216537 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216480 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.216765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlmjf\" (UniqueName: \"kubernetes.io/projected/1e1616ab-073c-4af0-8061-d796e3afe02d-kube-api-access-wlmjf\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.216765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5swbn\" (UniqueName: \"kubernetes.io/projected/2dae388d-4cf0-4fd4-868f-f8890245f60f-kube-api-access-5swbn\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.216765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2xrk\" (UniqueName: \"kubernetes.io/projected/e021b3c6-e89d-4940-b417-2d1073f6cd6d-kube-api-access-x2xrk\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:23.216765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e1616ab-073c-4af0-8061-d796e3afe02d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.216940 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:23.216940 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbttj\" (UniqueName: \"kubernetes.io/projected/625425a2-0237-473a-9a52-d238c29f9335-kube-api-access-bbttj\") pod \"volume-data-source-validator-5cf8c89d64-q9js4\" (UID: \"625425a2-0237-473a-9a52-d238c29f9335\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4" May 21 11:45:23.216940 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.216833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2dae388d-4cf0-4fd4-868f-f8890245f60f-snapshots\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.220619 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.220578 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 11:45:23.220619 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.220606 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 11:45:23.221649 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.221606 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b9954fc88-snzzt"] May 21 11:45:23.221995 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.221978 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 11:45:23.221995 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.221998 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2r8kq\"" May 21 11:45:23.224508 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.224490 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.226106 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.226083 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 11:45:23.227101 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.227081 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 11:45:23.227194 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.227088 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 11:45:23.227194 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.227143 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 11:45:23.227333 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.227237 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 11:45:23.227411 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.227394 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 11:45:23.227598 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.227583 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 11:45:23.227687 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.227670 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g2l8n\"" May 21 11:45:23.230313 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.230292 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 11:45:23.234309 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.234286 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8lzhv"] May 21 11:45:23.237830 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.237807 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b9954fc88-snzzt"] May 21 11:45:23.318000 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.317961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-config\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.318196 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318009 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlmjf\" (UniqueName: \"kubernetes.io/projected/1e1616ab-073c-4af0-8061-d796e3afe02d-kube-api-access-wlmjf\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.318196 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318041 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5swbn\" (UniqueName: \"kubernetes.io/projected/2dae388d-4cf0-4fd4-868f-f8890245f60f-kube-api-access-5swbn\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.318196 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.318196 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v96ff\" (UniqueName: \"kubernetes.io/projected/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-kube-api-access-v96ff\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.318196 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318092 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2xrk\" (UniqueName: \"kubernetes.io/projected/e021b3c6-e89d-4940-b417-2d1073f6cd6d-kube-api-access-x2xrk\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:23.318196 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318126 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e1616ab-073c-4af0-8061-d796e3afe02d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.318516 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jx8g\" (UniqueName: \"kubernetes.io/projected/a1b1c897-e8dc-4169-bd9d-0836b132e180-kube-api-access-9jx8g\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.318516 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318368 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:23.318516 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318397 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbttj\" (UniqueName: \"kubernetes.io/projected/625425a2-0237-473a-9a52-d238c29f9335-kube-api-access-bbttj\") pod \"volume-data-source-validator-5cf8c89d64-q9js4\" (UID: \"625425a2-0237-473a-9a52-d238c29f9335\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4" May 21 11:45:23.318516 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318431 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2dae388d-4cf0-4fd4-868f-f8890245f60f-snapshots\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.318516 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-stats-auth\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.318746 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.318519 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 11:45:23.318746 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.318595 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls podName:e021b3c6-e89d-4940-b417-2d1073f6cd6d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:23.81857463 +0000 UTC m=+97.247505504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls") pod "cluster-samples-operator-697587599-72995" (UID: "e021b3c6-e89d-4940-b417-2d1073f6cd6d") : secret "samples-operator-tls" not found May 21 11:45:23.318746 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318522 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dae388d-4cf0-4fd4-868f-f8890245f60f-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.318746 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-trusted-ca\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.318746 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318698 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dae388d-4cf0-4fd4-868f-f8890245f60f-tmp\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.318746 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318726 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dae388d-4cf0-4fd4-868f-f8890245f60f-serving-cert\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.318985 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318845 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.318985 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-serving-cert\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.318985 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318901 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e1616ab-073c-4af0-8061-d796e3afe02d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.318985 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318933 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dae388d-4cf0-4fd4-868f-f8890245f60f-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.318985 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.318963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-default-certificate\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.319171 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.318989 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 11:45:23.319171 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.319003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.319171 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.319015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dae388d-4cf0-4fd4-868f-f8890245f60f-tmp\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.319171 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.319048 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls podName:1e1616ab-073c-4af0-8061-d796e3afe02d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:23.819033626 +0000 UTC m=+97.247964471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h5bz2" (UID: "1e1616ab-073c-4af0-8061-d796e3afe02d") : secret "cluster-monitoring-operator-tls" not found May 21 11:45:23.319171 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.319123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2dae388d-4cf0-4fd4-868f-f8890245f60f-snapshots\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.319171 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.319124 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dae388d-4cf0-4fd4-868f-f8890245f60f-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.319699 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.319677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dae388d-4cf0-4fd4-868f-f8890245f60f-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.321139 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.321116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dae388d-4cf0-4fd4-868f-f8890245f60f-serving-cert\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.332309 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.332259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbttj\" (UniqueName: \"kubernetes.io/projected/625425a2-0237-473a-9a52-d238c29f9335-kube-api-access-bbttj\") pod \"volume-data-source-validator-5cf8c89d64-q9js4\" (UID: \"625425a2-0237-473a-9a52-d238c29f9335\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4" May 21 11:45:23.332433 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.332322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlmjf\" (UniqueName: \"kubernetes.io/projected/1e1616ab-073c-4af0-8061-d796e3afe02d-kube-api-access-wlmjf\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.332433 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.332331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2xrk\" (UniqueName: \"kubernetes.io/projected/e021b3c6-e89d-4940-b417-2d1073f6cd6d-kube-api-access-x2xrk\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:23.332712 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.332694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5swbn\" (UniqueName: \"kubernetes.io/projected/2dae388d-4cf0-4fd4-868f-f8890245f60f-kube-api-access-5swbn\") pod \"insights-operator-78bdfb888c-zg9v2\" (UID: \"2dae388d-4cf0-4fd4-868f-f8890245f60f\") " pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.419635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.419554 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.419635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.419591 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v96ff\" (UniqueName: \"kubernetes.io/projected/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-kube-api-access-v96ff\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.419635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.419624 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jx8g\" (UniqueName: \"kubernetes.io/projected/a1b1c897-e8dc-4169-bd9d-0836b132e180-kube-api-access-9jx8g\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.419887 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.419653 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-stats-auth\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.419887 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.419673 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-trusted-ca\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.419887 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.419745 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:23.919723785 +0000 UTC m=+97.348654632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : configmap references non-existent config key: service-ca.crt May 21 11:45:23.420121 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.419901 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-serving-cert\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.420121 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.419951 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-default-certificate\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.420121 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.419977 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.420121 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.420001 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-config\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.420121 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.420075 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 11:45:23.420356 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.420141 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:23.920123588 +0000 UTC m=+97.349054438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : secret "router-metrics-certs-default" not found May 21 11:45:23.420643 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.420611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-config\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.420918 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.420897 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-trusted-ca\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.422170 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.422149 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-serving-cert\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.422316 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.422298 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-stats-auth\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.422504 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.422487 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-default-certificate\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.428930 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.428910 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v96ff\" (UniqueName: \"kubernetes.io/projected/3df687e9-f288-4f8c-97a5-2e28ef81dd6f-kube-api-access-v96ff\") pod \"console-operator-76dff48d59-8lzhv\" (UID: \"3df687e9-f288-4f8c-97a5-2e28ef81dd6f\") " pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.429136 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.429118 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jx8g\" (UniqueName: \"kubernetes.io/projected/a1b1c897-e8dc-4169-bd9d-0836b132e180-kube-api-access-9jx8g\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.442857 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.442837 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4" May 21 11:45:23.447935 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.447900 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" May 21 11:45:23.526289 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.526237 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:23.590871 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.586858 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zg9v2"] May 21 11:45:23.617255 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.617214 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4"] May 21 11:45:23.620048 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:45:23.620021 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625425a2_0237_473a_9a52_d238c29f9335.slice/crio-ecf19d2c4b9d42830e4d40bfe2735fa7c30605ef6d8e37d9667c3f99fdc840bf WatchSource:0}: Error finding container ecf19d2c4b9d42830e4d40bfe2735fa7c30605ef6d8e37d9667c3f99fdc840bf: Status 404 returned error can't find the container with id ecf19d2c4b9d42830e4d40bfe2735fa7c30605ef6d8e37d9667c3f99fdc840bf May 21 11:45:23.670786 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.670712 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8lzhv"] May 21 11:45:23.673895 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:45:23.673867 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df687e9_f288_4f8c_97a5_2e28ef81dd6f.slice/crio-5940982fe6aa6396425deaaa2d9cac23a5aba116e293f8a7217857f5e5925fc8 WatchSource:0}: Error finding container 5940982fe6aa6396425deaaa2d9cac23a5aba116e293f8a7217857f5e5925fc8: Status 404 returned error can't find the container with id 5940982fe6aa6396425deaaa2d9cac23a5aba116e293f8a7217857f5e5925fc8 May 21 11:45:23.823849 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.823805 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:23.824114 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.823858 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:23.824114 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.823952 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 11:45:23.824114 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.823955 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 11:45:23.824114 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.824017 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls podName:e021b3c6-e89d-4940-b417-2d1073f6cd6d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:24.824001213 +0000 UTC m=+98.252932057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls") pod "cluster-samples-operator-697587599-72995" (UID: "e021b3c6-e89d-4940-b417-2d1073f6cd6d") : secret "samples-operator-tls" not found May 21 11:45:23.824114 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.824030 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls podName:1e1616ab-073c-4af0-8061-d796e3afe02d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:24.824024054 +0000 UTC m=+98.252954899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h5bz2" (UID: "1e1616ab-073c-4af0-8061-d796e3afe02d") : secret "cluster-monitoring-operator-tls" not found May 21 11:45:23.925098 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.925010 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.925098 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:23.925067 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:23.925319 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.925191 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 11:45:23.925319 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.925228 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:24.925215425 +0000 UTC m=+98.354146270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : configmap references non-existent config key: service-ca.crt May 21 11:45:23.925319 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:23.925248 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:24.92523536 +0000 UTC m=+98.354166205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : secret "router-metrics-certs-default" not found May 21 11:45:24.469157 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.469095 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" event={"ID":"3df687e9-f288-4f8c-97a5-2e28ef81dd6f","Type":"ContainerStarted","Data":"5940982fe6aa6396425deaaa2d9cac23a5aba116e293f8a7217857f5e5925fc8"} May 21 11:45:24.471439 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.471382 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" event={"ID":"2dae388d-4cf0-4fd4-868f-f8890245f60f","Type":"ContainerStarted","Data":"4fcc1229cf60ba246f492ca01a622812d9e016aabc5301420cc45419d48e1531"} May 21 11:45:24.472738 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.472703 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4" event={"ID":"625425a2-0237-473a-9a52-d238c29f9335","Type":"ContainerStarted","Data":"ecf19d2c4b9d42830e4d40bfe2735fa7c30605ef6d8e37d9667c3f99fdc840bf"} May 21 11:45:24.832376 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.832330 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:24.832376 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.832381 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:45:24.832620 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.832495 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:24.832620 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.832496 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 11:45:24.832620 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.832563 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 11:45:24.832620 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.832607 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls podName:1e1616ab-073c-4af0-8061-d796e3afe02d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:26.832585732 +0000 UTC m=+100.261516594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h5bz2" (UID: "1e1616ab-073c-4af0-8061-d796e3afe02d") : secret "cluster-monitoring-operator-tls" not found May 21 11:45:24.832816 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.832625 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert podName:fe84da0a-c03f-4d28-9d56-fdd9844b31bf nodeName:}" failed. No retries permitted until 2026-05-21 11:46:28.832616032 +0000 UTC m=+162.261546876 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert") pod "ingress-canary-vc87h" (UID: "fe84da0a-c03f-4d28-9d56-fdd9844b31bf") : secret "canary-serving-cert" not found May 21 11:45:24.832816 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.832670 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 11:45:24.832816 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.832710 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls podName:e021b3c6-e89d-4940-b417-2d1073f6cd6d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:26.832692742 +0000 UTC m=+100.261623593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls") pod "cluster-samples-operator-697587599-72995" (UID: "e021b3c6-e89d-4940-b417-2d1073f6cd6d") : secret "samples-operator-tls" not found May 21 11:45:24.933888 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.933847 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:24.934077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.933920 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:45:24.934077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:24.933948 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:24.934077 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.934016 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 11:45:24.934328 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.934090 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:26.934070598 +0000 UTC m=+100.363001458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : secret "router-metrics-certs-default" not found May 21 11:45:24.934328 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.934122 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:26.93410572 +0000 UTC m=+100.363036579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : configmap references non-existent config key: service-ca.crt May 21 11:45:24.934328 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.934191 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 11:45:24.934328 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:24.934228 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls podName:7fa9ae98-31db-45b3-9c64-90f571f92e8b nodeName:}" failed. No retries permitted until 2026-05-21 11:46:28.934217167 +0000 UTC m=+162.363148018 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls") pod "dns-default-5kkp2" (UID: "7fa9ae98-31db-45b3-9c64-90f571f92e8b") : secret "dns-default-metrics-tls" not found May 21 11:45:26.478436 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.478407 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/0.log" May 21 11:45:26.478900 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.478456 2565 generic.go:358] "Generic (PLEG): container finished" podID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" containerID="e4d68f6a7c5b4b92e9a0d2bfbe6ab36d6609aebb29faf4095fe4bdbbc7ec6707" exitCode=255 May 21 11:45:26.478900 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.478546 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" event={"ID":"3df687e9-f288-4f8c-97a5-2e28ef81dd6f","Type":"ContainerDied","Data":"e4d68f6a7c5b4b92e9a0d2bfbe6ab36d6609aebb29faf4095fe4bdbbc7ec6707"} May 21 11:45:26.478900 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.478786 2565 scope.go:117] "RemoveContainer" containerID="e4d68f6a7c5b4b92e9a0d2bfbe6ab36d6609aebb29faf4095fe4bdbbc7ec6707" May 21 11:45:26.484465 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.484409 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" event={"ID":"2dae388d-4cf0-4fd4-868f-f8890245f60f","Type":"ContainerStarted","Data":"8f88d1d3b1a0bb7015e31684cdaf7b4c383872de6b0fe7f33d6c4aed80b8a6b4"} May 21 11:45:26.485898 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.485869 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4" event={"ID":"625425a2-0237-473a-9a52-d238c29f9335","Type":"ContainerStarted","Data":"996cf6f8b381b59fa8cbd93dadaf081c548526e8751e2c78af7d6acf242fe209"} May 21 11:45:26.520757 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.520701 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q9js4" podStartSLOduration=0.86037853 podStartE2EDuration="3.520682109s" podCreationTimestamp="2026-05-21 11:45:23 +0000 UTC" firstStartedPulling="2026-05-21 11:45:23.621398553 +0000 UTC m=+97.050329397" lastFinishedPulling="2026-05-21 11:45:26.281702122 +0000 UTC m=+99.710632976" observedRunningTime="2026-05-21 11:45:26.520204701 +0000 UTC m=+99.949135568" watchObservedRunningTime="2026-05-21 11:45:26.520682109 +0000 UTC m=+99.949612976" May 21 11:45:26.543152 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.543104 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" podStartSLOduration=0.870587386 podStartE2EDuration="3.543089483s" podCreationTimestamp="2026-05-21 11:45:23 +0000 UTC" firstStartedPulling="2026-05-21 11:45:23.611450274 +0000 UTC m=+97.040381122" lastFinishedPulling="2026-05-21 11:45:26.283952361 +0000 UTC m=+99.712883219" observedRunningTime="2026-05-21 11:45:26.54196337 +0000 UTC m=+99.970894237" watchObservedRunningTime="2026-05-21 11:45:26.543089483 +0000 UTC m=+99.972020397" May 21 11:45:26.849676 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.849640 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:26.849852 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.849694 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:26.849852 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:26.849792 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 11:45:26.849852 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:26.849824 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 11:45:26.849980 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:26.849864 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls podName:e021b3c6-e89d-4940-b417-2d1073f6cd6d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:30.849847986 +0000 UTC m=+104.278778830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls") pod "cluster-samples-operator-697587599-72995" (UID: "e021b3c6-e89d-4940-b417-2d1073f6cd6d") : secret "samples-operator-tls" not found May 21 11:45:26.849980 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:26.849879 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls podName:1e1616ab-073c-4af0-8061-d796e3afe02d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:30.849872363 +0000 UTC m=+104.278803208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h5bz2" (UID: "1e1616ab-073c-4af0-8061-d796e3afe02d") : secret "cluster-monitoring-operator-tls" not found May 21 11:45:26.950358 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.950319 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:26.950577 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:26.950437 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:26.950577 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:26.950487 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:30.950467816 +0000 UTC m=+104.379398665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : configmap references non-existent config key: service-ca.crt May 21 11:45:26.950577 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:26.950533 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 11:45:26.950741 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:26.950584 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:30.950569791 +0000 UTC m=+104.379500655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : secret "router-metrics-certs-default" not found May 21 11:45:27.414688 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:27.414659 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ff7pn" May 21 11:45:27.489537 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:27.489509 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/1.log" May 21 11:45:27.489961 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:27.489938 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/0.log" May 21 11:45:27.490009 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:27.489972 2565 generic.go:358] "Generic (PLEG): container finished" podID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" containerID="966f97b002ab7ae432f649e12bc4bb05c3520f55894fd10323b19d9b361781b3" exitCode=255 May 21 11:45:27.490100 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:27.490072 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" event={"ID":"3df687e9-f288-4f8c-97a5-2e28ef81dd6f","Type":"ContainerDied","Data":"966f97b002ab7ae432f649e12bc4bb05c3520f55894fd10323b19d9b361781b3"} May 21 11:45:27.490211 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:27.490121 2565 scope.go:117] "RemoveContainer" containerID="e4d68f6a7c5b4b92e9a0d2bfbe6ab36d6609aebb29faf4095fe4bdbbc7ec6707" May 21 11:45:27.490341 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:27.490322 2565 scope.go:117] "RemoveContainer" containerID="966f97b002ab7ae432f649e12bc4bb05c3520f55894fd10323b19d9b361781b3" May 21 11:45:27.490550 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:27.490524 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8lzhv_openshift-console-operator(3df687e9-f288-4f8c-97a5-2e28ef81dd6f)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" podUID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" May 21 11:45:28.493482 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:28.493456 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/1.log" May 21 11:45:28.493937 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:28.493878 2565 scope.go:117] "RemoveContainer" containerID="966f97b002ab7ae432f649e12bc4bb05c3520f55894fd10323b19d9b361781b3" May 21 11:45:28.494100 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:28.494079 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8lzhv_openshift-console-operator(3df687e9-f288-4f8c-97a5-2e28ef81dd6f)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" podUID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" May 21 11:45:29.737554 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:29.737525 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fs9s4_5dfd9d49-f61c-4c0f-93bd-ae95abebb036/dns-node-resolver/0.log" May 21 11:45:30.538289 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:30.538242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cxw7j_b2eec013-9617-40a4-ac11-5e4eb5f17c0f/node-ca/0.log" May 21 11:45:30.881061 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:30.881016 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:30.881061 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:30.881067 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:30.881517 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:30.881159 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 11:45:30.881517 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:30.881199 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 11:45:30.881517 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:30.881226 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls podName:e021b3c6-e89d-4940-b417-2d1073f6cd6d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:38.881208147 +0000 UTC m=+112.310138992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls") pod "cluster-samples-operator-697587599-72995" (UID: "e021b3c6-e89d-4940-b417-2d1073f6cd6d") : secret "samples-operator-tls" not found May 21 11:45:30.881517 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:30.881244 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls podName:1e1616ab-073c-4af0-8061-d796e3afe02d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:38.881232704 +0000 UTC m=+112.310163549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h5bz2" (UID: "1e1616ab-073c-4af0-8061-d796e3afe02d") : secret "cluster-monitoring-operator-tls" not found May 21 11:45:30.981763 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:30.981722 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:30.981995 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:30.981851 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:30.981995 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:30.981901 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:38.981883497 +0000 UTC m=+112.410814343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : configmap references non-existent config key: service-ca.crt May 21 11:45:30.981995 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:30.981976 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 11:45:30.982140 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:30.982033 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:38.982017052 +0000 UTC m=+112.410947898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : secret "router-metrics-certs-default" not found May 21 11:45:33.526851 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:33.526811 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:33.526851 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:33.526856 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:33.527304 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:33.527177 2565 scope.go:117] "RemoveContainer" containerID="966f97b002ab7ae432f649e12bc4bb05c3520f55894fd10323b19d9b361781b3" May 21 11:45:33.527405 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:33.527387 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8lzhv_openshift-console-operator(3df687e9-f288-4f8c-97a5-2e28ef81dd6f)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" podUID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" May 21 11:45:38.944055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:38.944012 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:38.944547 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:38.944072 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:38.944547 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:38.944208 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 11:45:38.944547 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:38.944304 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls podName:1e1616ab-073c-4af0-8061-d796e3afe02d nodeName:}" failed. No retries permitted until 2026-05-21 11:45:54.9442613 +0000 UTC m=+128.373192145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h5bz2" (UID: "1e1616ab-073c-4af0-8061-d796e3afe02d") : secret "cluster-monitoring-operator-tls" not found May 21 11:45:38.946644 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:38.946623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e021b3c6-e89d-4940-b417-2d1073f6cd6d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-72995\" (UID: \"e021b3c6-e89d-4940-b417-2d1073f6cd6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:39.036343 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:39.036309 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" May 21 11:45:39.045481 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:39.045408 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:39.045620 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:39.045527 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:39.045620 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:39.045596 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 11:45:39.045737 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:39.045676 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:55.045655332 +0000 UTC m=+128.474586179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : secret "router-metrics-certs-default" not found May 21 11:45:39.045737 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:39.045703 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle podName:a1b1c897-e8dc-4169-bd9d-0836b132e180 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:55.045684337 +0000 UTC m=+128.474615198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle") pod "router-default-6b9954fc88-snzzt" (UID: "a1b1c897-e8dc-4169-bd9d-0836b132e180") : configmap references non-existent config key: service-ca.crt May 21 11:45:39.163585 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:39.163553 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995"] May 21 11:45:39.517036 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:39.516943 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" event={"ID":"e021b3c6-e89d-4940-b417-2d1073f6cd6d","Type":"ContainerStarted","Data":"295d5df7182973ae4840f3ce7f7b416f7ba3ba878fe7ab4e62259d05a8f0fa1b"} May 21 11:45:41.523504 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:41.523423 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" event={"ID":"e021b3c6-e89d-4940-b417-2d1073f6cd6d","Type":"ContainerStarted","Data":"21a6476d2702b439deab9eec4ce878fbe095df151689f066a97d8776f9b93fd1"} May 21 11:45:41.523504 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:41.523458 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" event={"ID":"e021b3c6-e89d-4940-b417-2d1073f6cd6d","Type":"ContainerStarted","Data":"81e41ea21b5897a34814ac480aa3630f70d86eab4da9104b1af7db0970e677fb"} May 21 11:45:41.544745 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:41.544690 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-72995" podStartSLOduration=16.581311951 podStartE2EDuration="18.544673795s" podCreationTimestamp="2026-05-21 11:45:23 +0000 UTC" firstStartedPulling="2026-05-21 11:45:39.203751285 +0000 UTC m=+112.632682129" lastFinishedPulling="2026-05-21 11:45:41.167113127 +0000 UTC m=+114.596043973" observedRunningTime="2026-05-21 11:45:41.544327857 +0000 UTC m=+114.973258724" watchObservedRunningTime="2026-05-21 11:45:41.544673795 +0000 UTC m=+114.973604661" May 21 11:45:48.156433 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:48.156390 2565 scope.go:117] "RemoveContainer" containerID="966f97b002ab7ae432f649e12bc4bb05c3520f55894fd10323b19d9b361781b3" May 21 11:45:48.543717 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:48.543633 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:45:48.544003 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:48.543988 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/1.log" May 21 11:45:48.544050 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:48.544022 2565 generic.go:358] "Generic (PLEG): container finished" podID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" containerID="f9b5c1e1bf37dd0b445a96d5c730b9c5e2921d4a603f970e982152f046d4848a" exitCode=255 May 21 11:45:48.544094 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:48.544079 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" event={"ID":"3df687e9-f288-4f8c-97a5-2e28ef81dd6f","Type":"ContainerDied","Data":"f9b5c1e1bf37dd0b445a96d5c730b9c5e2921d4a603f970e982152f046d4848a"} May 21 11:45:48.544144 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:48.544109 2565 scope.go:117] "RemoveContainer" containerID="966f97b002ab7ae432f649e12bc4bb05c3520f55894fd10323b19d9b361781b3" May 21 11:45:48.544462 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:48.544443 2565 scope.go:117] "RemoveContainer" containerID="f9b5c1e1bf37dd0b445a96d5c730b9c5e2921d4a603f970e982152f046d4848a" May 21 11:45:48.544676 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:48.544657 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8lzhv_openshift-console-operator(3df687e9-f288-4f8c-97a5-2e28ef81dd6f)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" podUID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" May 21 11:45:49.550037 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:49.550002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:45:53.527075 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:53.527025 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:53.527535 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:53.527113 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:45:53.527535 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:53.527453 2565 scope.go:117] "RemoveContainer" containerID="f9b5c1e1bf37dd0b445a96d5c730b9c5e2921d4a603f970e982152f046d4848a" May 21 11:45:53.527652 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:53.527633 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8lzhv_openshift-console-operator(3df687e9-f288-4f8c-97a5-2e28ef81dd6f)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" podUID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" May 21 11:45:53.558885 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:53.558860 2565 scope.go:117] "RemoveContainer" containerID="f9b5c1e1bf37dd0b445a96d5c730b9c5e2921d4a603f970e982152f046d4848a" May 21 11:45:53.559054 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:53.559022 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8lzhv_openshift-console-operator(3df687e9-f288-4f8c-97a5-2e28ef81dd6f)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" podUID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" May 21 11:45:54.968988 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:54.968952 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:54.971561 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:54.971543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e1616ab-073c-4af0-8061-d796e3afe02d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h5bz2\" (UID: \"1e1616ab-073c-4af0-8061-d796e3afe02d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:55.069688 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.069649 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:55.069880 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.069732 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:55.070399 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.070374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1b1c897-e8dc-4169-bd9d-0836b132e180-service-ca-bundle\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:55.072103 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.072086 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b1c897-e8dc-4169-bd9d-0836b132e180-metrics-certs\") pod \"router-default-6b9954fc88-snzzt\" (UID: \"a1b1c897-e8dc-4169-bd9d-0836b132e180\") " pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:55.230788 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.230706 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m84rm\"" May 21 11:45:55.238496 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.238473 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" May 21 11:45:55.336263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.336234 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g2l8n\"" May 21 11:45:55.344421 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.344397 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:55.372032 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.371993 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2"] May 21 11:45:55.374796 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:45:55.374770 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1616ab_073c_4af0_8061_d796e3afe02d.slice/crio-b3a9a653d4c17407dfbbde8a3d8c67aaefa1f17f535a02ac1aaaf38e79c761b9 WatchSource:0}: Error finding container b3a9a653d4c17407dfbbde8a3d8c67aaefa1f17f535a02ac1aaaf38e79c761b9: Status 404 returned error can't find the container with id b3a9a653d4c17407dfbbde8a3d8c67aaefa1f17f535a02ac1aaaf38e79c761b9 May 21 11:45:55.473612 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.473578 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b9954fc88-snzzt"] May 21 11:45:55.476128 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:45:55.476103 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b1c897_e8dc_4169_bd9d_0836b132e180.slice/crio-61e127bfb4deed132e67e194dbdb5901de8973d2ddc7d73b13f157bf3e6ba8df WatchSource:0}: Error finding container 61e127bfb4deed132e67e194dbdb5901de8973d2ddc7d73b13f157bf3e6ba8df: Status 404 returned error can't find the container with id 61e127bfb4deed132e67e194dbdb5901de8973d2ddc7d73b13f157bf3e6ba8df May 21 11:45:55.538300 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.538070 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8476f4fcc8-75q4s"] May 21 11:45:55.541889 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.541864 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.544581 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.544562 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 11:45:55.545091 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.545070 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vbb66\"" May 21 11:45:55.545185 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.545133 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 11:45:55.545185 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.545140 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 11:45:55.551850 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.551829 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 11:45:55.554206 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.554185 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8476f4fcc8-75q4s"] May 21 11:45:55.566077 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.566046 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b9954fc88-snzzt" event={"ID":"a1b1c897-e8dc-4169-bd9d-0836b132e180","Type":"ContainerStarted","Data":"ee17d414aa22b6ae98d4a7779a82052c508b107119344f68f3fa9767cfe71d0a"} May 21 11:45:55.566196 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.566086 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b9954fc88-snzzt" event={"ID":"a1b1c897-e8dc-4169-bd9d-0836b132e180","Type":"ContainerStarted","Data":"61e127bfb4deed132e67e194dbdb5901de8973d2ddc7d73b13f157bf3e6ba8df"} May 21 11:45:55.567030 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.567006 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" event={"ID":"1e1616ab-073c-4af0-8061-d796e3afe02d","Type":"ContainerStarted","Data":"b3a9a653d4c17407dfbbde8a3d8c67aaefa1f17f535a02ac1aaaf38e79c761b9"} May 21 11:45:55.592983 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.592941 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6b9954fc88-snzzt" podStartSLOduration=32.592926492 podStartE2EDuration="32.592926492s" podCreationTimestamp="2026-05-21 11:45:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:45:55.592288271 +0000 UTC m=+129.021219154" watchObservedRunningTime="2026-05-21 11:45:55.592926492 +0000 UTC m=+129.021857359" May 21 11:45:55.674346 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.674314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1283ace3-87c1-4dd1-9455-21a9f02ff307-trusted-ca\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.674346 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.674353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1283ace3-87c1-4dd1-9455-21a9f02ff307-installation-pull-secrets\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.674576 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.674392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-bound-sa-token\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.674576 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.674476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmjv9\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-kube-api-access-rmjv9\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.674576 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.674527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1283ace3-87c1-4dd1-9455-21a9f02ff307-registry-certificates\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.674711 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.674578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1283ace3-87c1-4dd1-9455-21a9f02ff307-image-registry-private-configuration\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.674711 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.674608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1283ace3-87c1-4dd1-9455-21a9f02ff307-ca-trust-extracted\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.674711 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.674634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-registry-tls\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.679049 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.679020 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w8dbq"] May 21 11:45:55.682296 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.682266 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.686641 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.686616 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9d8jx\"" May 21 11:45:55.687003 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.686976 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 11:45:55.687130 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.687021 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 11:45:55.696410 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.696384 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w8dbq"] May 21 11:45:55.775429 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1283ace3-87c1-4dd1-9455-21a9f02ff307-registry-certificates\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.775429 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775380 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/610df456-885d-427f-a743-163322e504f2-crio-socket\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.775429 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775406 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1283ace3-87c1-4dd1-9455-21a9f02ff307-image-registry-private-configuration\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.775667 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775601 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1283ace3-87c1-4dd1-9455-21a9f02ff307-ca-trust-extracted\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.775667 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775642 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-registry-tls\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.775748 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rblhz\" (UniqueName: \"kubernetes.io/projected/610df456-885d-427f-a743-163322e504f2-kube-api-access-rblhz\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.775784 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775746 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1283ace3-87c1-4dd1-9455-21a9f02ff307-trusted-ca\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.775784 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775774 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1283ace3-87c1-4dd1-9455-21a9f02ff307-installation-pull-secrets\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.775882 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/610df456-885d-427f-a743-163322e504f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.775882 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/610df456-885d-427f-a743-163322e504f2-data-volume\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.775882 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/610df456-885d-427f-a743-163322e504f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.776027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775913 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-bound-sa-token\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.776027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775948 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1283ace3-87c1-4dd1-9455-21a9f02ff307-ca-trust-extracted\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.776027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.775966 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmjv9\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-kube-api-access-rmjv9\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.776242 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.776219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1283ace3-87c1-4dd1-9455-21a9f02ff307-registry-certificates\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.776643 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.776579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1283ace3-87c1-4dd1-9455-21a9f02ff307-trusted-ca\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.778089 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.778063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1283ace3-87c1-4dd1-9455-21a9f02ff307-image-registry-private-configuration\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.778230 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.778212 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1283ace3-87c1-4dd1-9455-21a9f02ff307-installation-pull-secrets\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.778382 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.778366 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-registry-tls\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.787200 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.787179 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-bound-sa-token\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.788878 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.788860 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmjv9\" (UniqueName: \"kubernetes.io/projected/1283ace3-87c1-4dd1-9455-21a9f02ff307-kube-api-access-rmjv9\") pod \"image-registry-8476f4fcc8-75q4s\" (UID: \"1283ace3-87c1-4dd1-9455-21a9f02ff307\") " pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.852416 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.852380 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:55.877297 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.877249 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rblhz\" (UniqueName: \"kubernetes.io/projected/610df456-885d-427f-a743-163322e504f2-kube-api-access-rblhz\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.877424 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.877337 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/610df456-885d-427f-a743-163322e504f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.877424 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.877369 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/610df456-885d-427f-a743-163322e504f2-data-volume\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.877424 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.877402 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/610df456-885d-427f-a743-163322e504f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.877647 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.877618 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/610df456-885d-427f-a743-163322e504f2-crio-socket\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.877717 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.877696 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/610df456-885d-427f-a743-163322e504f2-data-volume\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.877775 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.877737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/610df456-885d-427f-a743-163322e504f2-crio-socket\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.877930 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.877913 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/610df456-885d-427f-a743-163322e504f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.879813 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.879791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/610df456-885d-427f-a743-163322e504f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.888747 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.888723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rblhz\" (UniqueName: \"kubernetes.io/projected/610df456-885d-427f-a743-163322e504f2-kube-api-access-rblhz\") pod \"insights-runtime-extractor-w8dbq\" (UID: \"610df456-885d-427f-a743-163322e504f2\") " pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:55.977338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.977300 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8476f4fcc8-75q4s"] May 21 11:45:55.981662 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:45:55.981636 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1283ace3_87c1_4dd1_9455_21a9f02ff307.slice/crio-2a2549b8a41e6fe496e3c24aa6cba7acf4b97eeadfe9a1b67e939c3e166a8c5f WatchSource:0}: Error finding container 2a2549b8a41e6fe496e3c24aa6cba7acf4b97eeadfe9a1b67e939c3e166a8c5f: Status 404 returned error can't find the container with id 2a2549b8a41e6fe496e3c24aa6cba7acf4b97eeadfe9a1b67e939c3e166a8c5f May 21 11:45:55.991180 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:55.991151 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w8dbq" May 21 11:45:56.134109 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.134051 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w8dbq"] May 21 11:45:56.137496 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:45:56.137465 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610df456_885d_427f_a743_163322e504f2.slice/crio-ce61d334269d1525eeec622f284e51d41a83385878c94b76a25e93cf6dc4cd63 WatchSource:0}: Error finding container ce61d334269d1525eeec622f284e51d41a83385878c94b76a25e93cf6dc4cd63: Status 404 returned error can't find the container with id ce61d334269d1525eeec622f284e51d41a83385878c94b76a25e93cf6dc4cd63 May 21 11:45:56.345287 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.345245 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:56.347891 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.347866 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:56.571093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.571054 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8dbq" event={"ID":"610df456-885d-427f-a743-163322e504f2","Type":"ContainerStarted","Data":"9ef9756dbf15f680f1b6aecb543dbd7557983040263c8670be7432360528d7ba"} May 21 11:45:56.571093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.571097 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8dbq" event={"ID":"610df456-885d-427f-a743-163322e504f2","Type":"ContainerStarted","Data":"ce61d334269d1525eeec622f284e51d41a83385878c94b76a25e93cf6dc4cd63"} May 21 11:45:56.572520 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.572472 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" event={"ID":"1283ace3-87c1-4dd1-9455-21a9f02ff307","Type":"ContainerStarted","Data":"f18a595cd7d80460f6e0998148ee1d250359195a21bba633ad6275bfd3eb8dc8"} May 21 11:45:56.572639 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.572521 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" event={"ID":"1283ace3-87c1-4dd1-9455-21a9f02ff307","Type":"ContainerStarted","Data":"2a2549b8a41e6fe496e3c24aa6cba7acf4b97eeadfe9a1b67e939c3e166a8c5f"} May 21 11:45:56.572701 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.572645 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:56.573985 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.573962 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b9954fc88-snzzt" May 21 11:45:56.593974 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.593927 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" podStartSLOduration=1.593913004 podStartE2EDuration="1.593913004s" podCreationTimestamp="2026-05-21 11:45:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:45:56.592427 +0000 UTC m=+130.021357858" watchObservedRunningTime="2026-05-21 11:45:56.593913004 +0000 UTC m=+130.022843872" May 21 11:45:56.988823 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.988736 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:45:56.991660 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:56.991630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8cbcbd3-2160-4238-8029-6d32911a0f6c-metrics-certs\") pod \"network-metrics-daemon-55klh\" (UID: \"e8cbcbd3-2160-4238-8029-6d32911a0f6c\") " pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:45:57.281042 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.280955 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ds8sh\"" May 21 11:45:57.289303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.289257 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55klh" May 21 11:45:57.518175 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.518149 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-55klh"] May 21 11:45:57.521151 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:45:57.521127 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cbcbd3_2160_4238_8029_6d32911a0f6c.slice/crio-31ae23b2e18a549c82c6b4bd27017bec822f5d851cb9609f3cb6b28e7831014f WatchSource:0}: Error finding container 31ae23b2e18a549c82c6b4bd27017bec822f5d851cb9609f3cb6b28e7831014f: Status 404 returned error can't find the container with id 31ae23b2e18a549c82c6b4bd27017bec822f5d851cb9609f3cb6b28e7831014f May 21 11:45:57.576252 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.576215 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55klh" event={"ID":"e8cbcbd3-2160-4238-8029-6d32911a0f6c","Type":"ContainerStarted","Data":"31ae23b2e18a549c82c6b4bd27017bec822f5d851cb9609f3cb6b28e7831014f"} May 21 11:45:57.577518 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.577488 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" event={"ID":"1e1616ab-073c-4af0-8061-d796e3afe02d","Type":"ContainerStarted","Data":"f56ae52d145651c48a2d50962cefafb6283ce650023e440e1187dfa8bc218296"} May 21 11:45:57.578967 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.578926 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8dbq" event={"ID":"610df456-885d-427f-a743-163322e504f2","Type":"ContainerStarted","Data":"76ab28195b362744d087cd5c55a4d7da89ea207c4b497273a86a32509308ba6e"} May 21 11:45:57.579314 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.579299 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:45:57.595233 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.595168 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h5bz2" podStartSLOduration=32.581271401 podStartE2EDuration="34.595150518s" podCreationTimestamp="2026-05-21 11:45:23 +0000 UTC" firstStartedPulling="2026-05-21 11:45:55.376542575 +0000 UTC m=+128.805473420" lastFinishedPulling="2026-05-21 11:45:57.390421689 +0000 UTC m=+130.819352537" observedRunningTime="2026-05-21 11:45:57.593692803 +0000 UTC m=+131.022623670" watchObservedRunningTime="2026-05-21 11:45:57.595150518 +0000 UTC m=+131.024081385" May 21 11:45:57.969859 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.969824 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27"] May 21 11:45:57.987351 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.987316 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27"] May 21 11:45:57.987525 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.987457 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:45:57.990243 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.990218 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 11:45:57.990653 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:57.990379 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d8df6\"" May 21 11:45:58.100205 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:58.100163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4gw27\" (UID: \"eb9288cc-358e-47e2-9e83-c1d1005cbed4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:45:58.200732 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:58.200685 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4gw27\" (UID: \"eb9288cc-358e-47e2-9e83-c1d1005cbed4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:45:58.200923 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:58.200856 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 21 11:45:58.200977 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:58.200954 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates podName:eb9288cc-358e-47e2-9e83-c1d1005cbed4 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:58.700936905 +0000 UTC m=+132.129867756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" (UID: "eb9288cc-358e-47e2-9e83-c1d1005cbed4") : secret "prometheus-operator-admission-webhook-tls" not found May 21 11:45:58.705301 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:58.705234 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4gw27\" (UID: \"eb9288cc-358e-47e2-9e83-c1d1005cbed4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:45:58.706253 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:58.706230 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 21 11:45:58.706386 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:45:58.706321 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates podName:eb9288cc-358e-47e2-9e83-c1d1005cbed4 nodeName:}" failed. No retries permitted until 2026-05-21 11:45:59.706298398 +0000 UTC m=+133.135229248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" (UID: "eb9288cc-358e-47e2-9e83-c1d1005cbed4") : secret "prometheus-operator-admission-webhook-tls" not found May 21 11:45:59.586602 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.586567 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8dbq" event={"ID":"610df456-885d-427f-a743-163322e504f2","Type":"ContainerStarted","Data":"5783e961445ad245d463bb2e72682f91a18eb2107d573a7b99f485501ace7c50"} May 21 11:45:59.588029 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.588007 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55klh" event={"ID":"e8cbcbd3-2160-4238-8029-6d32911a0f6c","Type":"ContainerStarted","Data":"1b683763696e141677f82a6d3e10b25eeeacb4b10523327e37e14a553bfd4a63"} May 21 11:45:59.588127 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.588034 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55klh" event={"ID":"e8cbcbd3-2160-4238-8029-6d32911a0f6c","Type":"ContainerStarted","Data":"34e8d20c0fbb96ae1c5e301d2609d063769501d86ab2c02448681e792be993df"} May 21 11:45:59.604966 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.604912 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w8dbq" podStartSLOduration=1.684037145 podStartE2EDuration="4.604896198s" podCreationTimestamp="2026-05-21 11:45:55 +0000 UTC" firstStartedPulling="2026-05-21 11:45:56.195034231 +0000 UTC m=+129.623965085" lastFinishedPulling="2026-05-21 11:45:59.115893293 +0000 UTC m=+132.544824138" observedRunningTime="2026-05-21 11:45:59.603747291 +0000 UTC m=+133.032678149" watchObservedRunningTime="2026-05-21 11:45:59.604896198 +0000 UTC m=+133.033827065" May 21 11:45:59.620162 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.620097 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-55klh" podStartSLOduration=131.027329347 podStartE2EDuration="2m12.620078566s" podCreationTimestamp="2026-05-21 11:43:47 +0000 UTC" firstStartedPulling="2026-05-21 11:45:57.523443509 +0000 UTC m=+130.952374361" lastFinishedPulling="2026-05-21 11:45:59.116192736 +0000 UTC m=+132.545123580" observedRunningTime="2026-05-21 11:45:59.618533115 +0000 UTC m=+133.047463985" watchObservedRunningTime="2026-05-21 11:45:59.620078566 +0000 UTC m=+133.049009434" May 21 11:45:59.714659 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.714615 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4gw27\" (UID: \"eb9288cc-358e-47e2-9e83-c1d1005cbed4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:45:59.717223 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.717198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eb9288cc-358e-47e2-9e83-c1d1005cbed4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4gw27\" (UID: \"eb9288cc-358e-47e2-9e83-c1d1005cbed4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:45:59.800436 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.800401 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:45:59.928377 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:45:59.928343 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27"] May 21 11:45:59.932128 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:45:59.932099 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9288cc_358e_47e2_9e83_c1d1005cbed4.slice/crio-36893e1c6c7c88d3b8416144802360ace1b2b64136de0a57b1878a7554eb1772 WatchSource:0}: Error finding container 36893e1c6c7c88d3b8416144802360ace1b2b64136de0a57b1878a7554eb1772: Status 404 returned error can't find the container with id 36893e1c6c7c88d3b8416144802360ace1b2b64136de0a57b1878a7554eb1772 May 21 11:46:00.592855 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:00.592812 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" event={"ID":"eb9288cc-358e-47e2-9e83-c1d1005cbed4","Type":"ContainerStarted","Data":"36893e1c6c7c88d3b8416144802360ace1b2b64136de0a57b1878a7554eb1772"} May 21 11:46:01.598348 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:01.598304 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" event={"ID":"eb9288cc-358e-47e2-9e83-c1d1005cbed4","Type":"ContainerStarted","Data":"49d067d7dc771c3bd914c5152363eb98991f8101a1d70723f8738c40a71bd699"} May 21 11:46:01.598800 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:01.598511 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:46:01.603331 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:01.603308 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" May 21 11:46:01.628826 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:01.628773 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4gw27" podStartSLOduration=3.677239432 podStartE2EDuration="4.628758052s" podCreationTimestamp="2026-05-21 11:45:57 +0000 UTC" firstStartedPulling="2026-05-21 11:45:59.934031407 +0000 UTC m=+133.362962252" lastFinishedPulling="2026-05-21 11:46:00.885550027 +0000 UTC m=+134.314480872" observedRunningTime="2026-05-21 11:46:01.628402263 +0000 UTC m=+135.057333131" watchObservedRunningTime="2026-05-21 11:46:01.628758052 +0000 UTC m=+135.057688918" May 21 11:46:02.040569 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.040484 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4"] May 21 11:46:02.044682 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.044664 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.047413 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.047393 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 11:46:02.047941 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.047924 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vf9gc\"" May 21 11:46:02.048958 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.048942 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 11:46:02.049015 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.048942 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 11:46:02.059380 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.059357 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4"] May 21 11:46:02.134416 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.134383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86672746-1cf7-4504-9a35-4044d21a9972-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.134416 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.134425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.134634 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.134519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.134634 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.134571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qjcr\" (UniqueName: \"kubernetes.io/projected/86672746-1cf7-4504-9a35-4044d21a9972-kube-api-access-7qjcr\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.235141 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.235105 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.235326 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.235155 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qjcr\" (UniqueName: \"kubernetes.io/projected/86672746-1cf7-4504-9a35-4044d21a9972-kube-api-access-7qjcr\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.235326 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.235186 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86672746-1cf7-4504-9a35-4044d21a9972-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.235326 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.235206 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.235576 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:46:02.235343 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 21 11:46:02.235576 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:46:02.235401 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-tls podName:86672746-1cf7-4504-9a35-4044d21a9972 nodeName:}" failed. No retries permitted until 2026-05-21 11:46:02.735384949 +0000 UTC m=+136.164315793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-gnwf4" (UID: "86672746-1cf7-4504-9a35-4044d21a9972") : secret "prometheus-operator-tls" not found May 21 11:46:02.235958 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.235930 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86672746-1cf7-4504-9a35-4044d21a9972-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.237714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.237694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.248074 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.248049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qjcr\" (UniqueName: \"kubernetes.io/projected/86672746-1cf7-4504-9a35-4044d21a9972-kube-api-access-7qjcr\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.739322 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.739265 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.741816 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.741786 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/86672746-1cf7-4504-9a35-4044d21a9972-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gnwf4\" (UID: \"86672746-1cf7-4504-9a35-4044d21a9972\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:02.953578 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:02.953544 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" May 21 11:46:03.083005 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:03.082972 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4"] May 21 11:46:03.086227 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:03.086191 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86672746_1cf7_4504_9a35_4044d21a9972.slice/crio-073ea7c2664f1a1b6cc3a0af91ecd1f0d2ef06523c4e00a0b4d5ac318fbc4d10 WatchSource:0}: Error finding container 073ea7c2664f1a1b6cc3a0af91ecd1f0d2ef06523c4e00a0b4d5ac318fbc4d10: Status 404 returned error can't find the container with id 073ea7c2664f1a1b6cc3a0af91ecd1f0d2ef06523c4e00a0b4d5ac318fbc4d10 May 21 11:46:03.603916 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:03.603881 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" event={"ID":"86672746-1cf7-4504-9a35-4044d21a9972","Type":"ContainerStarted","Data":"073ea7c2664f1a1b6cc3a0af91ecd1f0d2ef06523c4e00a0b4d5ac318fbc4d10"} May 21 11:46:05.621638 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:05.621603 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" event={"ID":"86672746-1cf7-4504-9a35-4044d21a9972","Type":"ContainerStarted","Data":"89cc6b32036e0bf437340b33f246fa5140e2977ace73db0ef43828101d0ab4c0"} May 21 11:46:05.621638 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:05.621640 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" event={"ID":"86672746-1cf7-4504-9a35-4044d21a9972","Type":"ContainerStarted","Data":"fec3ddcd5e9be10557d1165fdc3a158301fffa4d3c284e0d300ca7109aa84f65"} May 21 11:46:05.641106 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:05.641059 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gnwf4" podStartSLOduration=2.162015287 podStartE2EDuration="3.641045529s" podCreationTimestamp="2026-05-21 11:46:02 +0000 UTC" firstStartedPulling="2026-05-21 11:46:03.088132529 +0000 UTC m=+136.517063375" lastFinishedPulling="2026-05-21 11:46:04.567162769 +0000 UTC m=+137.996093617" observedRunningTime="2026-05-21 11:46:05.638885456 +0000 UTC m=+139.067816323" watchObservedRunningTime="2026-05-21 11:46:05.641045529 +0000 UTC m=+139.069976395" May 21 11:46:07.158724 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.158696 2565 scope.go:117] "RemoveContainer" containerID="f9b5c1e1bf37dd0b445a96d5c730b9c5e2921d4a603f970e982152f046d4848a" May 21 11:46:07.159181 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:46:07.158929 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8lzhv_openshift-console-operator(3df687e9-f288-4f8c-97a5-2e28ef81dd6f)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" podUID="3df687e9-f288-4f8c-97a5-2e28ef81dd6f" May 21 11:46:07.473828 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.473743 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lwpqd"] May 21 11:46:07.477189 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.477169 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.477894 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.477878 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.477973 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.477906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8j9r\" (UniqueName: \"kubernetes.io/projected/ee560e03-fd64-40af-b623-495f9d0994c6-kube-api-access-s8j9r\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.477973 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.477925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee560e03-fd64-40af-b623-495f9d0994c6-metrics-client-ca\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.478054 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.477997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-root\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.478054 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.478029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-tls\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.478119 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.478059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-sys\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.478119 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.478093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-wtmp\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.478179 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.478138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-textfile\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.478179 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.478155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.480117 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.480091 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c756g\"" May 21 11:46:07.480117 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.480108 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 11:46:07.480225 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.480091 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 11:46:07.480225 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.480145 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 11:46:07.578565 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578530 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8j9r\" (UniqueName: \"kubernetes.io/projected/ee560e03-fd64-40af-b623-495f9d0994c6-kube-api-access-s8j9r\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578565 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578571 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee560e03-fd64-40af-b623-495f9d0994c6-metrics-client-ca\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578606 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-root\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578626 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-tls\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578649 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-sys\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578684 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-wtmp\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-root\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578718 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-textfile\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-sys\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.578811 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:46:07.578800 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 11:46:07.579263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578814 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.579263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578843 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-wtmp\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.579263 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:46:07.578866 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-tls podName:ee560e03-fd64-40af-b623-495f9d0994c6 nodeName:}" failed. No retries permitted until 2026-05-21 11:46:08.078845317 +0000 UTC m=+141.507776178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-tls") pod "node-exporter-lwpqd" (UID: "ee560e03-fd64-40af-b623-495f9d0994c6") : secret "node-exporter-tls" not found May 21 11:46:07.579263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.578908 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.579263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.579061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-textfile\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.579263 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.579231 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee560e03-fd64-40af-b623-495f9d0994c6-metrics-client-ca\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.579523 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.579346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.581286 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.581256 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:07.589397 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:07.589374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8j9r\" (UniqueName: \"kubernetes.io/projected/ee560e03-fd64-40af-b623-495f9d0994c6-kube-api-access-s8j9r\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:08.082429 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.082386 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-tls\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:08.084836 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.084812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee560e03-fd64-40af-b623-495f9d0994c6-node-exporter-tls\") pod \"node-exporter-lwpqd\" (UID: \"ee560e03-fd64-40af-b623-495f9d0994c6\") " pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:08.085736 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.085717 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lwpqd" May 21 11:46:08.094629 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:08.094594 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee560e03_fd64_40af_b623_495f9d0994c6.slice/crio-14acced8645340363e80f9bf6c0233c3518c2a2918b7295a451587fee556ff10 WatchSource:0}: Error finding container 14acced8645340363e80f9bf6c0233c3518c2a2918b7295a451587fee556ff10: Status 404 returned error can't find the container with id 14acced8645340363e80f9bf6c0233c3518c2a2918b7295a451587fee556ff10 May 21 11:46:08.587635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.587599 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:46:08.598210 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.598172 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.601641 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.601454 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 11:46:08.601641 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.601542 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 11:46:08.601641 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.601636 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 11:46:08.602047 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.602024 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 11:46:08.602169 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.602047 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 11:46:08.602169 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.602048 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 11:46:08.602169 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.602097 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xmjml\"" May 21 11:46:08.603139 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.603116 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 11:46:08.606669 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.606649 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 11:46:08.607725 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.607700 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 11:46:08.624938 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.624886 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:46:08.631981 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.631942 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwpqd" event={"ID":"ee560e03-fd64-40af-b623-495f9d0994c6","Type":"ContainerStarted","Data":"14acced8645340363e80f9bf6c0233c3518c2a2918b7295a451587fee556ff10"} May 21 11:46:08.686963 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.686923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687149 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.686970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-out\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687149 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687423 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687423 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687423 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687423 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlrgw\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-kube-api-access-mlrgw\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687423 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687704 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687704 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687704 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-volume\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687704 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.687704 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.687542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-web-config\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788424 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788389 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788604 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788468 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788604 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788496 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788604 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788536 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlrgw\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-kube-api-access-mlrgw\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788604 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788566 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788604 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788596 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788854 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788633 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788933 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788903 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-volume\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788997 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788956 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.788997 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.788990 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-web-config\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.789093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.789030 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.789093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.789054 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-out\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.789339 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.789096 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.789837 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.789550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.789837 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.789608 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.790030 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.789988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.793126 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.792924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-volume\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.793126 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.792999 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.793336 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.793288 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.793774 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.793497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.794787 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.793958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-web-config\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.794787 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.793991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.794787 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.794189 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-out\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.794787 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.794638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.795556 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.795532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.797764 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.797742 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlrgw\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-kube-api-access-mlrgw\") pod \"alertmanager-main-0\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:08.911469 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:08.911394 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 11:46:09.150755 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:09.150708 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:46:09.155107 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:09.155081 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005f138b_1f25_43b9_a518_cbb7e875cbfc.slice/crio-22a72a6c9e99d7c8df69ecb275a5b03cd5c0dbc64b73bc07f896d7a7d5c769a8 WatchSource:0}: Error finding container 22a72a6c9e99d7c8df69ecb275a5b03cd5c0dbc64b73bc07f896d7a7d5c769a8: Status 404 returned error can't find the container with id 22a72a6c9e99d7c8df69ecb275a5b03cd5c0dbc64b73bc07f896d7a7d5c769a8 May 21 11:46:09.636933 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:09.636901 2565 generic.go:358] "Generic (PLEG): container finished" podID="ee560e03-fd64-40af-b623-495f9d0994c6" containerID="7778295ff4b94a71548869ea2cbca86b006ef62ad093a9737f4de6eb2a34ee0c" exitCode=0 May 21 11:46:09.637399 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:09.636987 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwpqd" event={"ID":"ee560e03-fd64-40af-b623-495f9d0994c6","Type":"ContainerDied","Data":"7778295ff4b94a71548869ea2cbca86b006ef62ad093a9737f4de6eb2a34ee0c"} May 21 11:46:09.638207 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:09.638168 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerStarted","Data":"22a72a6c9e99d7c8df69ecb275a5b03cd5c0dbc64b73bc07f896d7a7d5c769a8"} May 21 11:46:10.642527 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:10.642490 2565 generic.go:358] "Generic (PLEG): container finished" podID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerID="53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470" exitCode=0 May 21 11:46:10.642924 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:10.642571 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerDied","Data":"53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470"} May 21 11:46:10.644590 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:10.644563 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwpqd" event={"ID":"ee560e03-fd64-40af-b623-495f9d0994c6","Type":"ContainerStarted","Data":"b310c309f66995103379b282c6d7ff625bc48496709a4197502f99a565771c54"} May 21 11:46:10.644691 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:10.644596 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwpqd" event={"ID":"ee560e03-fd64-40af-b623-495f9d0994c6","Type":"ContainerStarted","Data":"80fdfa7157da300e4ca9f33b7972e247a70f9ccad74974387d8d639d6c2d4ac2"} May 21 11:46:10.733993 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:10.733925 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lwpqd" podStartSLOduration=2.778805282 podStartE2EDuration="3.733901267s" podCreationTimestamp="2026-05-21 11:46:07 +0000 UTC" firstStartedPulling="2026-05-21 11:46:08.096511462 +0000 UTC m=+141.525442307" lastFinishedPulling="2026-05-21 11:46:09.051607435 +0000 UTC m=+142.480538292" observedRunningTime="2026-05-21 11:46:10.732405098 +0000 UTC m=+144.161335977" watchObservedRunningTime="2026-05-21 11:46:10.733901267 +0000 UTC m=+144.162832135" May 21 11:46:11.742628 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.742588 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-759766f98-2tgn9"] May 21 11:46:11.746005 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.745982 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.749745 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.749721 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 11:46:11.751108 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.751085 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g8s2g\"" May 21 11:46:11.751232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.751107 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 11:46:11.751232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.751177 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 11:46:11.751483 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.751464 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 11:46:11.751566 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.751509 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f1ov7j6ut993u\"" May 21 11:46:11.757506 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.757478 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-759766f98-2tgn9"] May 21 11:46:11.818707 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.818675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93bfd407-aaad-452e-84b6-6890cb484a33-audit-log\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.818872 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.818729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93bfd407-aaad-452e-84b6-6890cb484a33-metrics-server-audit-profiles\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.818872 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.818807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-client-ca-bundle\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.818942 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.818869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93bfd407-aaad-452e-84b6-6890cb484a33-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.818942 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.818896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-secret-metrics-server-tls\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.818942 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.818923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfkzt\" (UniqueName: \"kubernetes.io/projected/93bfd407-aaad-452e-84b6-6890cb484a33-kube-api-access-bfkzt\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.819033 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.818968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-secret-metrics-server-client-certs\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.920191 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.920147 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93bfd407-aaad-452e-84b6-6890cb484a33-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.920393 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.920217 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-secret-metrics-server-tls\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.920393 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.920246 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfkzt\" (UniqueName: \"kubernetes.io/projected/93bfd407-aaad-452e-84b6-6890cb484a33-kube-api-access-bfkzt\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.920393 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.920330 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-secret-metrics-server-client-certs\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.920393 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.920370 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93bfd407-aaad-452e-84b6-6890cb484a33-audit-log\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.920607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.920444 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93bfd407-aaad-452e-84b6-6890cb484a33-metrics-server-audit-profiles\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.920607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.920486 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-client-ca-bundle\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.921064 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.921009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93bfd407-aaad-452e-84b6-6890cb484a33-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.921064 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.921013 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93bfd407-aaad-452e-84b6-6890cb484a33-audit-log\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.921486 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.921465 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93bfd407-aaad-452e-84b6-6890cb484a33-metrics-server-audit-profiles\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.923596 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.923566 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-client-ca-bundle\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.923686 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.923614 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-secret-metrics-server-tls\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.923804 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.923782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93bfd407-aaad-452e-84b6-6890cb484a33-secret-metrics-server-client-certs\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:11.930831 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:11.930783 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfkzt\" (UniqueName: \"kubernetes.io/projected/93bfd407-aaad-452e-84b6-6890cb484a33-kube-api-access-bfkzt\") pod \"metrics-server-759766f98-2tgn9\" (UID: \"93bfd407-aaad-452e-84b6-6890cb484a33\") " pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:12.057301 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:12.057201 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:12.312934 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:12.312905 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-759766f98-2tgn9"] May 21 11:46:12.315248 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:12.315221 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bfd407_aaad_452e_84b6_6890cb484a33.slice/crio-48db961b81e7340e9af1b147fd170e40f4b461da5468facfd9c641099935784b WatchSource:0}: Error finding container 48db961b81e7340e9af1b147fd170e40f4b461da5468facfd9c641099935784b: Status 404 returned error can't find the container with id 48db961b81e7340e9af1b147fd170e40f4b461da5468facfd9c641099935784b May 21 11:46:12.653859 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:12.653825 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerStarted","Data":"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74"} May 21 11:46:12.653859 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:12.653864 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerStarted","Data":"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8"} May 21 11:46:12.654103 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:12.653877 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerStarted","Data":"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e"} May 21 11:46:12.654103 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:12.653892 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerStarted","Data":"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187"} May 21 11:46:12.654103 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:12.653903 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerStarted","Data":"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25"} May 21 11:46:12.654805 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:12.654782 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" event={"ID":"93bfd407-aaad-452e-84b6-6890cb484a33","Type":"ContainerStarted","Data":"48db961b81e7340e9af1b147fd170e40f4b461da5468facfd9c641099935784b"} May 21 11:46:13.662878 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:13.662838 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerStarted","Data":"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0"} May 21 11:46:13.694249 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:13.694175 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.578638864 podStartE2EDuration="5.694151794s" podCreationTimestamp="2026-05-21 11:46:08 +0000 UTC" firstStartedPulling="2026-05-21 11:46:09.157791924 +0000 UTC m=+142.586722773" lastFinishedPulling="2026-05-21 11:46:13.273304844 +0000 UTC m=+146.702235703" observedRunningTime="2026-05-21 11:46:13.692182405 +0000 UTC m=+147.121113313" watchObservedRunningTime="2026-05-21 11:46:13.694151794 +0000 UTC m=+147.123082665" May 21 11:46:14.666469 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:14.666420 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" event={"ID":"93bfd407-aaad-452e-84b6-6890cb484a33","Type":"ContainerStarted","Data":"d98921fbf35a1822ae1f6e72635d6189c70b321fd5b0be5fb1a5d95a9fe549fe"} May 21 11:46:14.699327 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:14.699249 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" podStartSLOduration=2.1145988940000002 podStartE2EDuration="3.699230328s" podCreationTimestamp="2026-05-21 11:46:11 +0000 UTC" firstStartedPulling="2026-05-21 11:46:12.317198775 +0000 UTC m=+145.746129621" lastFinishedPulling="2026-05-21 11:46:13.901830209 +0000 UTC m=+147.330761055" observedRunningTime="2026-05-21 11:46:14.697303422 +0000 UTC m=+148.126234286" watchObservedRunningTime="2026-05-21 11:46:14.699230328 +0000 UTC m=+148.128161196" May 21 11:46:18.592739 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:18.592709 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8476f4fcc8-75q4s" May 21 11:46:22.156690 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:22.156658 2565 scope.go:117] "RemoveContainer" containerID="f9b5c1e1bf37dd0b445a96d5c730b9c5e2921d4a603f970e982152f046d4848a" May 21 11:46:22.693385 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:22.693355 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:46:22.693576 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:22.693410 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" event={"ID":"3df687e9-f288-4f8c-97a5-2e28ef81dd6f","Type":"ContainerStarted","Data":"31184a5fb2d481e3dd0f98f61507d764b8255f65affd08e90dc68431393075ee"} May 21 11:46:22.693798 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:22.693775 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:46:22.712657 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:22.712595 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" podStartSLOduration=57.101898794 podStartE2EDuration="59.712576271s" podCreationTimestamp="2026-05-21 11:45:23 +0000 UTC" firstStartedPulling="2026-05-21 11:45:23.67567193 +0000 UTC m=+97.104602774" lastFinishedPulling="2026-05-21 11:45:26.286349406 +0000 UTC m=+99.715280251" observedRunningTime="2026-05-21 11:46:22.712078052 +0000 UTC m=+156.141008918" watchObservedRunningTime="2026-05-21 11:46:22.712576271 +0000 UTC m=+156.141507138" May 21 11:46:23.037459 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.037372 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-8lzhv" May 21 11:46:23.217824 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.217788 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-wz99x"] May 21 11:46:23.224057 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.224028 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-wz99x" May 21 11:46:23.227169 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.227140 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 11:46:23.227354 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.227228 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p2rp6\"" May 21 11:46:23.227354 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.227295 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 11:46:23.239142 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.239107 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-wz99x"] May 21 11:46:23.321097 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.321058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9glx\" (UniqueName: \"kubernetes.io/projected/da248605-9c7a-4ff6-ba03-d2ff928d9bfa-kube-api-access-q9glx\") pod \"downloads-57bd96b888-wz99x\" (UID: \"da248605-9c7a-4ff6-ba03-d2ff928d9bfa\") " pod="openshift-console/downloads-57bd96b888-wz99x" May 21 11:46:23.421733 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.421680 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9glx\" (UniqueName: \"kubernetes.io/projected/da248605-9c7a-4ff6-ba03-d2ff928d9bfa-kube-api-access-q9glx\") pod \"downloads-57bd96b888-wz99x\" (UID: \"da248605-9c7a-4ff6-ba03-d2ff928d9bfa\") " pod="openshift-console/downloads-57bd96b888-wz99x" May 21 11:46:23.430856 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.430823 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9glx\" (UniqueName: \"kubernetes.io/projected/da248605-9c7a-4ff6-ba03-d2ff928d9bfa-kube-api-access-q9glx\") pod \"downloads-57bd96b888-wz99x\" (UID: \"da248605-9c7a-4ff6-ba03-d2ff928d9bfa\") " pod="openshift-console/downloads-57bd96b888-wz99x" May 21 11:46:23.533026 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.532996 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-wz99x" May 21 11:46:23.673867 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.673828 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-wz99x"] May 21 11:46:23.677382 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:23.677339 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda248605_9c7a_4ff6_ba03_d2ff928d9bfa.slice/crio-7c88c0ef47eb4a19fc94b06198613d7bd7806963afc0963a41ec48335af9b000 WatchSource:0}: Error finding container 7c88c0ef47eb4a19fc94b06198613d7bd7806963afc0963a41ec48335af9b000: Status 404 returned error can't find the container with id 7c88c0ef47eb4a19fc94b06198613d7bd7806963afc0963a41ec48335af9b000 May 21 11:46:23.697423 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:23.697384 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-wz99x" event={"ID":"da248605-9c7a-4ff6-ba03-d2ff928d9bfa","Type":"ContainerStarted","Data":"7c88c0ef47eb4a19fc94b06198613d7bd7806963afc0963a41ec48335af9b000"} May 21 11:46:23.925883 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:46:23.925783 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vc87h" podUID="fe84da0a-c03f-4d28-9d56-fdd9844b31bf" May 21 11:46:24.024220 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:46:24.024174 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5kkp2" podUID="7fa9ae98-31db-45b3-9c64-90f571f92e8b" May 21 11:46:24.700308 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:24.700256 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5kkp2" May 21 11:46:24.700308 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:24.700262 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:46:28.149002 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.148872 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-78c874cdf9-4cbpb"] May 21 11:46:28.153516 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.153480 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.156394 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.156371 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 11:46:28.156543 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.156430 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 11:46:28.157624 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.157603 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 11:46:28.157765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.157609 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 11:46:28.157859 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.157662 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bwdvd\"" May 21 11:46:28.157931 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.157625 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 11:46:28.165477 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.165451 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c874cdf9-4cbpb"] May 21 11:46:28.267085 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.267047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-oauth-serving-cert\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.267085 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.267085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-oauth-config\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.267330 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.267154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-service-ca\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.267330 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.267235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-serving-cert\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.267399 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.267331 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv6rp\" (UniqueName: \"kubernetes.io/projected/5e66b4ff-fa87-4d73-b932-8cf52739ea18-kube-api-access-fv6rp\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.267399 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.267368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-config\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.368475 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.368433 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-service-ca\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.368662 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.368537 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-serving-cert\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.368662 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.368591 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fv6rp\" (UniqueName: \"kubernetes.io/projected/5e66b4ff-fa87-4d73-b932-8cf52739ea18-kube-api-access-fv6rp\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.368815 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.368788 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-config\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.368886 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.368846 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-oauth-serving-cert\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.368955 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.368890 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-oauth-config\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.369298 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.369234 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-service-ca\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.369553 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.369530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-config\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.369648 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.369587 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-oauth-serving-cert\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.371356 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.371336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-serving-cert\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.372069 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.372049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-oauth-config\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.378044 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.378024 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv6rp\" (UniqueName: \"kubernetes.io/projected/5e66b4ff-fa87-4d73-b932-8cf52739ea18-kube-api-access-fv6rp\") pod \"console-78c874cdf9-4cbpb\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.465746 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.465657 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:28.620918 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.620783 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c874cdf9-4cbpb"] May 21 11:46:28.623997 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:28.623953 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e66b4ff_fa87_4d73_b932_8cf52739ea18.slice/crio-111fd5d2176b1823674977e3d86f85e360f609997eb7249d0cf12be6a4c32959 WatchSource:0}: Error finding container 111fd5d2176b1823674977e3d86f85e360f609997eb7249d0cf12be6a4c32959: Status 404 returned error can't find the container with id 111fd5d2176b1823674977e3d86f85e360f609997eb7249d0cf12be6a4c32959 May 21 11:46:28.716096 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.716009 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c874cdf9-4cbpb" event={"ID":"5e66b4ff-fa87-4d73-b932-8cf52739ea18","Type":"ContainerStarted","Data":"111fd5d2176b1823674977e3d86f85e360f609997eb7249d0cf12be6a4c32959"} May 21 11:46:28.874744 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.874696 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:46:28.877536 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.877505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe84da0a-c03f-4d28-9d56-fdd9844b31bf-cert\") pod \"ingress-canary-vc87h\" (UID: \"fe84da0a-c03f-4d28-9d56-fdd9844b31bf\") " pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:46:28.904203 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.904167 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cwzz8\"" May 21 11:46:28.911798 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.911757 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vc87h" May 21 11:46:28.976028 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.975995 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:46:28.980895 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:28.980823 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fa9ae98-31db-45b3-9c64-90f571f92e8b-metrics-tls\") pod \"dns-default-5kkp2\" (UID: \"7fa9ae98-31db-45b3-9c64-90f571f92e8b\") " pod="openshift-dns/dns-default-5kkp2" May 21 11:46:29.072862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:29.072834 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vc87h"] May 21 11:46:29.075411 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:29.075380 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe84da0a_c03f_4d28_9d56_fdd9844b31bf.slice/crio-c411806d54b185651985eeb3049bb89a5b5a87e85a4ac05a4139e16c2d989d6a WatchSource:0}: Error finding container c411806d54b185651985eeb3049bb89a5b5a87e85a4ac05a4139e16c2d989d6a: Status 404 returned error can't find the container with id c411806d54b185651985eeb3049bb89a5b5a87e85a4ac05a4139e16c2d989d6a May 21 11:46:29.204261 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:29.204233 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6x8vn\"" May 21 11:46:29.211856 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:29.211814 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5kkp2" May 21 11:46:29.392899 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:29.392846 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5kkp2"] May 21 11:46:29.397662 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:29.397626 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa9ae98_31db_45b3_9c64_90f571f92e8b.slice/crio-b2913ee31f6a123a71a64f88b365886334cc414102868baf0f490d29c9270355 WatchSource:0}: Error finding container b2913ee31f6a123a71a64f88b365886334cc414102868baf0f490d29c9270355: Status 404 returned error can't find the container with id b2913ee31f6a123a71a64f88b365886334cc414102868baf0f490d29c9270355 May 21 11:46:29.723154 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:29.723099 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5kkp2" event={"ID":"7fa9ae98-31db-45b3-9c64-90f571f92e8b","Type":"ContainerStarted","Data":"b2913ee31f6a123a71a64f88b365886334cc414102868baf0f490d29c9270355"} May 21 11:46:29.725070 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:29.725040 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vc87h" event={"ID":"fe84da0a-c03f-4d28-9d56-fdd9844b31bf","Type":"ContainerStarted","Data":"c411806d54b185651985eeb3049bb89a5b5a87e85a4ac05a4139e16c2d989d6a"} May 21 11:46:32.057457 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:32.057407 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:32.058091 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:32.057732 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:33.742862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:33.742811 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5kkp2" event={"ID":"7fa9ae98-31db-45b3-9c64-90f571f92e8b","Type":"ContainerStarted","Data":"b04814c522eeaeae55bf66cada8a2b86240de36043bf965cc29a518c266ba80a"} May 21 11:46:33.742862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:33.742861 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5kkp2" event={"ID":"7fa9ae98-31db-45b3-9c64-90f571f92e8b","Type":"ContainerStarted","Data":"d2bd3833fd9901cbdbdd7fa38b5c8c29f16eb713f0a9adb2d28eca4ebd9e69fa"} May 21 11:46:33.743427 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:33.742936 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5kkp2" May 21 11:46:33.744603 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:33.744569 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c874cdf9-4cbpb" event={"ID":"5e66b4ff-fa87-4d73-b932-8cf52739ea18","Type":"ContainerStarted","Data":"3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99"} May 21 11:46:33.746078 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:33.746043 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vc87h" event={"ID":"fe84da0a-c03f-4d28-9d56-fdd9844b31bf","Type":"ContainerStarted","Data":"d726c60911422a5950cc5dd1481343e0a8564387041295cf508b7b6142cd72a2"} May 21 11:46:33.763503 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:33.763393 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-5kkp2" podStartSLOduration=130.32077272 podStartE2EDuration="2m13.76337345s" podCreationTimestamp="2026-05-21 11:44:20 +0000 UTC" firstStartedPulling="2026-05-21 11:46:29.400332696 +0000 UTC m=+162.829263552" lastFinishedPulling="2026-05-21 11:46:32.842933437 +0000 UTC m=+166.271864282" observedRunningTime="2026-05-21 11:46:33.761123737 +0000 UTC m=+167.190054617" watchObservedRunningTime="2026-05-21 11:46:33.76337345 +0000 UTC m=+167.192304319" May 21 11:46:33.777830 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:33.777774 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vc87h" podStartSLOduration=130.014588339 podStartE2EDuration="2m13.777756399s" podCreationTimestamp="2026-05-21 11:44:20 +0000 UTC" firstStartedPulling="2026-05-21 11:46:29.077766138 +0000 UTC m=+162.506696984" lastFinishedPulling="2026-05-21 11:46:32.840934193 +0000 UTC m=+166.269865044" observedRunningTime="2026-05-21 11:46:33.776993054 +0000 UTC m=+167.205923920" watchObservedRunningTime="2026-05-21 11:46:33.777756399 +0000 UTC m=+167.206687267" May 21 11:46:33.796256 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:33.796187 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-78c874cdf9-4cbpb" podStartSLOduration=1.574015784 podStartE2EDuration="5.796164845s" podCreationTimestamp="2026-05-21 11:46:28 +0000 UTC" firstStartedPulling="2026-05-21 11:46:28.626191584 +0000 UTC m=+162.055122430" lastFinishedPulling="2026-05-21 11:46:32.848340635 +0000 UTC m=+166.277271491" observedRunningTime="2026-05-21 11:46:33.794137237 +0000 UTC m=+167.223068104" watchObservedRunningTime="2026-05-21 11:46:33.796164845 +0000 UTC m=+167.225095713" May 21 11:46:35.741265 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.741181 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c887f465-cwz8b"] May 21 11:46:35.745941 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.745914 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.755432 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.755398 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 11:46:35.759574 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.759542 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c887f465-cwz8b"] May 21 11:46:35.841313 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.841256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-oauth-config\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.841507 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.841323 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-config\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.841507 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.841410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kn68\" (UniqueName: \"kubernetes.io/projected/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-kube-api-access-4kn68\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.841507 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.841437 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-serving-cert\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.841507 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.841474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-oauth-serving-cert\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.841713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.841587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-service-ca\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.841713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.841641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-trusted-ca-bundle\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.942894 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.942859 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-service-ca\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.943093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.942910 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-trusted-ca-bundle\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.943093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.942958 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-oauth-config\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.943093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.942974 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-config\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.943093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.943066 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kn68\" (UniqueName: \"kubernetes.io/projected/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-kube-api-access-4kn68\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.943362 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.943118 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-serving-cert\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.943554 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.943525 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-oauth-serving-cert\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.944225 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.944158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-service-ca\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.944366 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.944317 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-trusted-ca-bundle\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.944584 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.944556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-config\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.944691 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.944620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-oauth-serving-cert\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.949259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.947084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-oauth-config\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.949259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.947450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-serving-cert\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:35.954779 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:35.954744 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kn68\" (UniqueName: \"kubernetes.io/projected/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-kube-api-access-4kn68\") pod \"console-7c887f465-cwz8b\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:36.059452 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:36.059348 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:38.465997 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:38.465957 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:38.465997 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:38.466002 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:38.472723 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:38.472700 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:38.765812 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:38.765724 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:46:40.857477 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:40.857441 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c887f465-cwz8b"] May 21 11:46:40.861031 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:46:40.861004 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c1e6e9_02f3_49ed_97ce_0fcb1d46d435.slice/crio-22b7554d8acbd2d6b1f5595c7a7fe22ae042cd845d696be77938bc130ac8b1a5 WatchSource:0}: Error finding container 22b7554d8acbd2d6b1f5595c7a7fe22ae042cd845d696be77938bc130ac8b1a5: Status 404 returned error can't find the container with id 22b7554d8acbd2d6b1f5595c7a7fe22ae042cd845d696be77938bc130ac8b1a5 May 21 11:46:41.773618 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:41.773574 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-wz99x" event={"ID":"da248605-9c7a-4ff6-ba03-d2ff928d9bfa","Type":"ContainerStarted","Data":"d366721f9570b225be84cee629cbcee56a6858710d9f0698ec0d7116420d7d2c"} May 21 11:46:41.773896 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:41.773871 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-wz99x" May 21 11:46:41.775319 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:41.775265 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c887f465-cwz8b" event={"ID":"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435","Type":"ContainerStarted","Data":"0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc"} May 21 11:46:41.775485 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:41.775468 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c887f465-cwz8b" event={"ID":"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435","Type":"ContainerStarted","Data":"22b7554d8acbd2d6b1f5595c7a7fe22ae042cd845d696be77938bc130ac8b1a5"} May 21 11:46:41.792883 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:41.792851 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-wz99x" May 21 11:46:41.812025 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:41.811960 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-wz99x" podStartSLOduration=1.6693939420000001 podStartE2EDuration="18.811939425s" podCreationTimestamp="2026-05-21 11:46:23 +0000 UTC" firstStartedPulling="2026-05-21 11:46:23.679625838 +0000 UTC m=+157.108556684" lastFinishedPulling="2026-05-21 11:46:40.822171322 +0000 UTC m=+174.251102167" observedRunningTime="2026-05-21 11:46:41.792864027 +0000 UTC m=+175.221794935" watchObservedRunningTime="2026-05-21 11:46:41.811939425 +0000 UTC m=+175.240870292" May 21 11:46:43.752668 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:43.752634 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5kkp2" May 21 11:46:43.771109 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:43.771050 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7c887f465-cwz8b" podStartSLOduration=8.771029119 podStartE2EDuration="8.771029119s" podCreationTimestamp="2026-05-21 11:46:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:46:41.833217514 +0000 UTC m=+175.262148382" watchObservedRunningTime="2026-05-21 11:46:43.771029119 +0000 UTC m=+177.199959987" May 21 11:46:46.059967 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:46.059922 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:46.059967 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:46.059963 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:46.065838 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:46.065809 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:46.797318 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:46.797265 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c887f465-cwz8b" May 21 11:46:46.845049 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:46.845003 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c874cdf9-4cbpb"] May 21 11:46:47.798042 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:47.797999 2565 generic.go:358] "Generic (PLEG): container finished" podID="2dae388d-4cf0-4fd4-868f-f8890245f60f" containerID="8f88d1d3b1a0bb7015e31684cdaf7b4c383872de6b0fe7f33d6c4aed80b8a6b4" exitCode=0 May 21 11:46:47.798532 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:47.798083 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" event={"ID":"2dae388d-4cf0-4fd4-868f-f8890245f60f","Type":"ContainerDied","Data":"8f88d1d3b1a0bb7015e31684cdaf7b4c383872de6b0fe7f33d6c4aed80b8a6b4"} May 21 11:46:47.798663 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:47.798635 2565 scope.go:117] "RemoveContainer" containerID="8f88d1d3b1a0bb7015e31684cdaf7b4c383872de6b0fe7f33d6c4aed80b8a6b4" May 21 11:46:48.803949 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:48.803916 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zg9v2" event={"ID":"2dae388d-4cf0-4fd4-868f-f8890245f60f","Type":"ContainerStarted","Data":"f4490f7b4704e5776af5d3645ab878cca896bb93e0c1deb8d9938256ed5b94e2"} May 21 11:46:52.062812 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:52.062782 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:46:52.066774 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:46:52.066744 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-759766f98-2tgn9" May 21 11:47:11.872069 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:11.872005 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-78c874cdf9-4cbpb" podUID="5e66b4ff-fa87-4d73-b932-8cf52739ea18" containerName="console" containerID="cri-o://3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99" gracePeriod=15 May 21 11:47:12.127729 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.127672 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78c874cdf9-4cbpb_5e66b4ff-fa87-4d73-b932-8cf52739ea18/console/0.log" May 21 11:47:12.127834 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.127745 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:47:12.277244 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277208 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-serving-cert\") pod \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " May 21 11:47:12.277450 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277301 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-oauth-serving-cert\") pod \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " May 21 11:47:12.277450 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277411 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-oauth-config\") pod \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " May 21 11:47:12.277580 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277468 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv6rp\" (UniqueName: \"kubernetes.io/projected/5e66b4ff-fa87-4d73-b932-8cf52739ea18-kube-api-access-fv6rp\") pod \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " May 21 11:47:12.277580 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277493 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-service-ca\") pod \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " May 21 11:47:12.277580 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277532 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-config\") pod \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\" (UID: \"5e66b4ff-fa87-4d73-b932-8cf52739ea18\") " May 21 11:47:12.277728 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277674 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e66b4ff-fa87-4d73-b932-8cf52739ea18" (UID: "5e66b4ff-fa87-4d73-b932-8cf52739ea18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:47:12.277922 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277899 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-oauth-serving-cert\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:12.277922 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277896 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e66b4ff-fa87-4d73-b932-8cf52739ea18" (UID: "5e66b4ff-fa87-4d73-b932-8cf52739ea18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:47:12.278081 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.277953 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-config" (OuterVolumeSpecName: "console-config") pod "5e66b4ff-fa87-4d73-b932-8cf52739ea18" (UID: "5e66b4ff-fa87-4d73-b932-8cf52739ea18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:47:12.279756 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.279717 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e66b4ff-fa87-4d73-b932-8cf52739ea18" (UID: "5e66b4ff-fa87-4d73-b932-8cf52739ea18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:12.279756 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.279738 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e66b4ff-fa87-4d73-b932-8cf52739ea18" (UID: "5e66b4ff-fa87-4d73-b932-8cf52739ea18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:12.279885 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.279768 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e66b4ff-fa87-4d73-b932-8cf52739ea18-kube-api-access-fv6rp" (OuterVolumeSpecName: "kube-api-access-fv6rp") pod "5e66b4ff-fa87-4d73-b932-8cf52739ea18" (UID: "5e66b4ff-fa87-4d73-b932-8cf52739ea18"). InnerVolumeSpecName "kube-api-access-fv6rp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:47:12.378535 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.378447 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-oauth-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:12.378535 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.378476 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv6rp\" (UniqueName: \"kubernetes.io/projected/5e66b4ff-fa87-4d73-b932-8cf52739ea18-kube-api-access-fv6rp\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:12.378535 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.378486 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-service-ca\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:12.378535 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.378495 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:12.378535 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.378504 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e66b4ff-fa87-4d73-b932-8cf52739ea18-console-serving-cert\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:12.875135 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.875104 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78c874cdf9-4cbpb_5e66b4ff-fa87-4d73-b932-8cf52739ea18/console/0.log" May 21 11:47:12.875135 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.875145 2565 generic.go:358] "Generic (PLEG): container finished" podID="5e66b4ff-fa87-4d73-b932-8cf52739ea18" containerID="3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99" exitCode=2 May 21 11:47:12.875635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.875179 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c874cdf9-4cbpb" event={"ID":"5e66b4ff-fa87-4d73-b932-8cf52739ea18","Type":"ContainerDied","Data":"3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99"} May 21 11:47:12.875635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.875214 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c874cdf9-4cbpb" event={"ID":"5e66b4ff-fa87-4d73-b932-8cf52739ea18","Type":"ContainerDied","Data":"111fd5d2176b1823674977e3d86f85e360f609997eb7249d0cf12be6a4c32959"} May 21 11:47:12.875635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.875222 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c874cdf9-4cbpb" May 21 11:47:12.875635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.875229 2565 scope.go:117] "RemoveContainer" containerID="3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99" May 21 11:47:12.883787 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.883771 2565 scope.go:117] "RemoveContainer" containerID="3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99" May 21 11:47:12.884036 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:47:12.884017 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99\": container with ID starting with 3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99 not found: ID does not exist" containerID="3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99" May 21 11:47:12.884105 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.884049 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99"} err="failed to get container status \"3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99\": rpc error: code = NotFound desc = could not find container \"3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99\": container with ID starting with 3ae6159e77e9ca84238fdebd513930deb55051f9b5f2ab4822736a1eb62a8e99 not found: ID does not exist" May 21 11:47:12.896927 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.896898 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c874cdf9-4cbpb"] May 21 11:47:12.899872 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:12.899849 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78c874cdf9-4cbpb"] May 21 11:47:13.160598 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:13.160504 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e66b4ff-fa87-4d73-b932-8cf52739ea18" path="/var/lib/kubelet/pods/5e66b4ff-fa87-4d73-b932-8cf52739ea18/volumes" May 21 11:47:27.817616 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:27.817581 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:47:27.818065 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:27.818041 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="alertmanager" containerID="cri-o://27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25" gracePeriod=120 May 21 11:47:27.818147 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:27.818115 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="prom-label-proxy" containerID="cri-o://d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0" gracePeriod=120 May 21 11:47:27.818201 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:27.818154 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy-web" containerID="cri-o://9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e" gracePeriod=120 May 21 11:47:27.818201 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:27.818164 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy" containerID="cri-o://5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8" gracePeriod=120 May 21 11:47:27.818329 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:27.818089 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy-metric" containerID="cri-o://f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74" gracePeriod=120 May 21 11:47:27.818329 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:27.818206 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="config-reloader" containerID="cri-o://608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187" gracePeriod=120 May 21 11:47:28.929475 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:28.929445 2565 generic.go:358] "Generic (PLEG): container finished" podID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerID="d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0" exitCode=0 May 21 11:47:28.929475 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:28.929469 2565 generic.go:358] "Generic (PLEG): container finished" podID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerID="5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8" exitCode=0 May 21 11:47:28.929888 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:28.929518 2565 generic.go:358] "Generic (PLEG): container finished" podID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerID="608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187" exitCode=0 May 21 11:47:28.929888 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:28.929517 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerDied","Data":"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0"} May 21 11:47:28.929888 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:28.929565 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerDied","Data":"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8"} May 21 11:47:28.929888 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:28.929575 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerDied","Data":"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187"} May 21 11:47:28.929888 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:28.929583 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerDied","Data":"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25"} May 21 11:47:28.929888 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:28.929528 2565 generic.go:358] "Generic (PLEG): container finished" podID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerID="27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25" exitCode=0 May 21 11:47:29.065520 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.065494 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:29.227145 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227068 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-tls-assets\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227145 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227105 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-trusted-ca-bundle\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227145 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227132 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-metrics-client-ca\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227158 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-cluster-tls-config\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227179 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-main-db\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227199 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlrgw\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-kube-api-access-mlrgw\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227245 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-web-config\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227318 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-main-tls\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227361 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227388 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-web\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.227446 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227415 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-volume\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.228083 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227844 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-out\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.228083 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.227939 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy\") pod \"005f138b-1f25-43b9-a518-cbb7e875cbfc\" (UID: \"005f138b-1f25-43b9-a518-cbb7e875cbfc\") " May 21 11:47:29.228083 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.228001 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:47:29.228083 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.228024 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:47:29.230433 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.230178 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:47:29.230552 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.230507 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.230552 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.230531 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005f138b-1f25-43b9-a518-cbb7e875cbfc-metrics-client-ca\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.230660 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.230555 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-alertmanager-main-db\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.231001 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.230975 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:47:29.233351 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.232024 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:29.237951 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.237904 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:29.238171 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.238144 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-kube-api-access-mlrgw" (OuterVolumeSpecName: "kube-api-access-mlrgw") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "kube-api-access-mlrgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:47:29.239560 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.239514 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-volume" (OuterVolumeSpecName: "config-volume") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:29.240043 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.240018 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:29.240043 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.240023 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-out" (OuterVolumeSpecName: "config-out") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:47:29.240292 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.240254 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:29.241079 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.241062 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:29.247210 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.247190 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-web-config" (OuterVolumeSpecName: "web-config") pod "005f138b-1f25-43b9-a518-cbb7e875cbfc" (UID: "005f138b-1f25-43b9-a518-cbb7e875cbfc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:47:29.331999 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.331959 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-main-tls\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.331999 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.331997 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.331999 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.332010 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.331999 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.332021 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-volume\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.332383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.332031 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/005f138b-1f25-43b9-a518-cbb7e875cbfc-config-out\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.332383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.332043 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.332383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.332057 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-tls-assets\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.332383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.332078 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-cluster-tls-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.332383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.332086 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlrgw\" (UniqueName: \"kubernetes.io/projected/005f138b-1f25-43b9-a518-cbb7e875cbfc-kube-api-access-mlrgw\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.332383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.332097 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/005f138b-1f25-43b9-a518-cbb7e875cbfc-web-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:47:29.935285 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.935245 2565 generic.go:358] "Generic (PLEG): container finished" podID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerID="f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74" exitCode=0 May 21 11:47:29.935285 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.935289 2565 generic.go:358] "Generic (PLEG): container finished" podID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerID="9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e" exitCode=0 May 21 11:47:29.935728 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.935334 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerDied","Data":"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74"} May 21 11:47:29.935728 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.935372 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerDied","Data":"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e"} May 21 11:47:29.935728 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.935384 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"005f138b-1f25-43b9-a518-cbb7e875cbfc","Type":"ContainerDied","Data":"22a72a6c9e99d7c8df69ecb275a5b03cd5c0dbc64b73bc07f896d7a7d5c769a8"} May 21 11:47:29.935728 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.935389 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:29.935728 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.935399 2565 scope.go:117] "RemoveContainer" containerID="d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0" May 21 11:47:29.942890 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.942864 2565 scope.go:117] "RemoveContainer" containerID="f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74" May 21 11:47:29.949938 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.949913 2565 scope.go:117] "RemoveContainer" containerID="5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8" May 21 11:47:29.957675 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.957656 2565 scope.go:117] "RemoveContainer" containerID="9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e" May 21 11:47:29.964371 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.964351 2565 scope.go:117] "RemoveContainer" containerID="608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187" May 21 11:47:29.971334 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.971259 2565 scope.go:117] "RemoveContainer" containerID="27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25" May 21 11:47:29.978680 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.978659 2565 scope.go:117] "RemoveContainer" containerID="53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470" May 21 11:47:29.980704 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.980680 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:47:29.985619 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.985603 2565 scope.go:117] "RemoveContainer" containerID="d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0" May 21 11:47:29.985879 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:47:29.985860 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0\": container with ID starting with d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0 not found: ID does not exist" containerID="d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0" May 21 11:47:29.985932 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.985891 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0"} err="failed to get container status \"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0\": rpc error: code = NotFound desc = could not find container \"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0\": container with ID starting with d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0 not found: ID does not exist" May 21 11:47:29.985932 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.985915 2565 scope.go:117] "RemoveContainer" containerID="f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74" May 21 11:47:29.986140 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:47:29.986121 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74\": container with ID starting with f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74 not found: ID does not exist" containerID="f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74" May 21 11:47:29.986188 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.986147 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74"} err="failed to get container status \"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74\": rpc error: code = NotFound desc = could not find container \"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74\": container with ID starting with f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74 not found: ID does not exist" May 21 11:47:29.986188 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.986164 2565 scope.go:117] "RemoveContainer" containerID="5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8" May 21 11:47:29.986430 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:47:29.986412 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8\": container with ID starting with 5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8 not found: ID does not exist" containerID="5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8" May 21 11:47:29.986487 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.986435 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8"} err="failed to get container status \"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8\": rpc error: code = NotFound desc = could not find container \"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8\": container with ID starting with 5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8 not found: ID does not exist" May 21 11:47:29.986487 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.986448 2565 scope.go:117] "RemoveContainer" containerID="9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e" May 21 11:47:29.986719 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:47:29.986700 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e\": container with ID starting with 9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e not found: ID does not exist" containerID="9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e" May 21 11:47:29.986816 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.986723 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e"} err="failed to get container status \"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e\": rpc error: code = NotFound desc = could not find container \"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e\": container with ID starting with 9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e not found: ID does not exist" May 21 11:47:29.986816 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.986738 2565 scope.go:117] "RemoveContainer" containerID="608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187" May 21 11:47:29.986973 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:47:29.986953 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187\": container with ID starting with 608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187 not found: ID does not exist" containerID="608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187" May 21 11:47:29.987009 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.986977 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187"} err="failed to get container status \"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187\": rpc error: code = NotFound desc = could not find container \"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187\": container with ID starting with 608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187 not found: ID does not exist" May 21 11:47:29.987009 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.986989 2565 scope.go:117] "RemoveContainer" containerID="27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25" May 21 11:47:29.987186 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:47:29.987172 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25\": container with ID starting with 27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25 not found: ID does not exist" containerID="27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25" May 21 11:47:29.987242 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.987187 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25"} err="failed to get container status \"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25\": rpc error: code = NotFound desc = could not find container \"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25\": container with ID starting with 27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25 not found: ID does not exist" May 21 11:47:29.987242 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.987203 2565 scope.go:117] "RemoveContainer" containerID="53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470" May 21 11:47:29.987426 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:47:29.987408 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470\": container with ID starting with 53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470 not found: ID does not exist" containerID="53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470" May 21 11:47:29.987465 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.987431 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470"} err="failed to get container status \"53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470\": rpc error: code = NotFound desc = could not find container \"53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470\": container with ID starting with 53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470 not found: ID does not exist" May 21 11:47:29.987465 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.987451 2565 scope.go:117] "RemoveContainer" containerID="d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0" May 21 11:47:29.987655 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.987639 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0"} err="failed to get container status \"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0\": rpc error: code = NotFound desc = could not find container \"d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0\": container with ID starting with d8d7f799c02764b2cb1280770c0cd1c5b447b2c8aeff22cedb54428d8e16c0e0 not found: ID does not exist" May 21 11:47:29.987702 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.987655 2565 scope.go:117] "RemoveContainer" containerID="f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74" May 21 11:47:29.987925 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.987906 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74"} err="failed to get container status \"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74\": rpc error: code = NotFound desc = could not find container \"f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74\": container with ID starting with f9bb93c8feca382fabd63747d22c831ef96c0df55fff2388d5b595ce1ad4ef74 not found: ID does not exist" May 21 11:47:29.987971 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.987926 2565 scope.go:117] "RemoveContainer" containerID="5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8" May 21 11:47:29.988145 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.988123 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8"} err="failed to get container status \"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8\": rpc error: code = NotFound desc = could not find container \"5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8\": container with ID starting with 5cb4224f3772b73d2578dd93f9886b62564056d8f4456ff25a51c0fdb4ffcff8 not found: ID does not exist" May 21 11:47:29.988145 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.988142 2565 scope.go:117] "RemoveContainer" containerID="9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e" May 21 11:47:29.988365 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.988349 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e"} err="failed to get container status \"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e\": rpc error: code = NotFound desc = could not find container \"9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e\": container with ID starting with 9a3275866c98f5f8b32814794721a73075f5aab8b7d16720fcba1caf31e6957e not found: ID does not exist" May 21 11:47:29.988421 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.988365 2565 scope.go:117] "RemoveContainer" containerID="608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187" May 21 11:47:29.988605 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.988587 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187"} err="failed to get container status \"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187\": rpc error: code = NotFound desc = could not find container \"608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187\": container with ID starting with 608301c41d9a3ddd7b84ead18a87b4c703361920db66288fa71efd1a5a7bf187 not found: ID does not exist" May 21 11:47:29.988652 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.988605 2565 scope.go:117] "RemoveContainer" containerID="27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25" May 21 11:47:29.988852 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.988836 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25"} err="failed to get container status \"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25\": rpc error: code = NotFound desc = could not find container \"27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25\": container with ID starting with 27f221fe311ee4f3c67221d54b373cdee1ab505ae55c9b69ba4c8fd364ca5d25 not found: ID does not exist" May 21 11:47:29.988898 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.988852 2565 scope.go:117] "RemoveContainer" containerID="53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470" May 21 11:47:29.989106 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.989067 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470"} err="failed to get container status \"53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470\": rpc error: code = NotFound desc = could not find container \"53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470\": container with ID starting with 53a75d7482658f89f0ece783dcf89d47530d000ca8f50ace36dea2ec1fd79470 not found: ID does not exist" May 21 11:47:29.991783 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:29.991762 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:47:30.044155 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044117 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:47:30.044459 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044445 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy" May 21 11:47:30.044510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044463 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy" May 21 11:47:30.044510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044474 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="init-config-reloader" May 21 11:47:30.044510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044480 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="init-config-reloader" May 21 11:47:30.044510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044489 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy-metric" May 21 11:47:30.044510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044495 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy-metric" May 21 11:47:30.044510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044506 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="prom-label-proxy" May 21 11:47:30.044510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044511 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="prom-label-proxy" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044519 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e66b4ff-fa87-4d73-b932-8cf52739ea18" containerName="console" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044525 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e66b4ff-fa87-4d73-b932-8cf52739ea18" containerName="console" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044532 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="alertmanager" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044542 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="alertmanager" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044552 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy-web" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044557 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy-web" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044564 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="config-reloader" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044569 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="config-reloader" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044627 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy-web" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044635 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy-metric" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044640 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e66b4ff-fa87-4d73-b932-8cf52739ea18" containerName="console" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044648 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="config-reloader" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044655 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="prom-label-proxy" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044661 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="kube-rbac-proxy" May 21 11:47:30.044713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.044668 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" containerName="alertmanager" May 21 11:47:30.047988 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.047969 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.054681 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.054653 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 11:47:30.055324 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.055303 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 11:47:30.055715 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.055698 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 11:47:30.055925 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.055891 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xmjml\"" May 21 11:47:30.056064 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.056025 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 11:47:30.056064 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.056046 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 11:47:30.056260 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.056242 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 11:47:30.056793 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.056779 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 11:47:30.057144 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.057129 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 11:47:30.060630 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.060611 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 11:47:30.075079 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.075051 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:47:30.238644 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238644 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5dxv\" (UniqueName: \"kubernetes.io/projected/c715913f-0913-43b6-adde-ddec7d1130f6-kube-api-access-b5dxv\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c715913f-0913-43b6-adde-ddec7d1130f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c715913f-0913-43b6-adde-ddec7d1130f6-config-out\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238757 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c715913f-0913-43b6-adde-ddec7d1130f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-web-config\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.238862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.239118 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.239118 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c715913f-0913-43b6-adde-ddec7d1130f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.239118 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.238913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c715913f-0913-43b6-adde-ddec7d1130f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.339972 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.339935 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c715913f-0913-43b6-adde-ddec7d1130f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340118 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.339977 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340183 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340121 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5dxv\" (UniqueName: \"kubernetes.io/projected/c715913f-0913-43b6-adde-ddec7d1130f6-kube-api-access-b5dxv\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340240 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340207 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c715913f-0913-43b6-adde-ddec7d1130f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340329 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340239 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340442 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340422 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c715913f-0913-43b6-adde-ddec7d1130f6-config-out\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340627 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340588 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c715913f-0913-43b6-adde-ddec7d1130f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340627 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340571 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340808 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340658 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340808 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340692 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c715913f-0913-43b6-adde-ddec7d1130f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340808 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340716 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c715913f-0913-43b6-adde-ddec7d1130f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.340808 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340730 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-web-config\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.341011 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.340881 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.341081 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.341007 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.341081 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.341037 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c715913f-0913-43b6-adde-ddec7d1130f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.343586 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.343559 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.343586 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.343576 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c715913f-0913-43b6-adde-ddec7d1130f6-config-out\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.343749 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.343638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.343807 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.343745 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.343807 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.343754 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c715913f-0913-43b6-adde-ddec7d1130f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.343932 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.343909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.344238 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.344217 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c715913f-0913-43b6-adde-ddec7d1130f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.344359 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.344337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.344504 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.344487 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-web-config\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.346009 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.345992 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c715913f-0913-43b6-adde-ddec7d1130f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.349363 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.349345 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5dxv\" (UniqueName: \"kubernetes.io/projected/c715913f-0913-43b6-adde-ddec7d1130f6-kube-api-access-b5dxv\") pod \"alertmanager-main-0\" (UID: \"c715913f-0913-43b6-adde-ddec7d1130f6\") " pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.357190 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.357170 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 11:47:30.495113 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.495010 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 11:47:30.498479 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:47:30.498450 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc715913f_0913_43b6_adde_ddec7d1130f6.slice/crio-2a304f7495b46818a92c1a78aa20f8d7aef89002adafd9c76abb3ebbd015b159 WatchSource:0}: Error finding container 2a304f7495b46818a92c1a78aa20f8d7aef89002adafd9c76abb3ebbd015b159: Status 404 returned error can't find the container with id 2a304f7495b46818a92c1a78aa20f8d7aef89002adafd9c76abb3ebbd015b159 May 21 11:47:30.942243 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.942205 2565 generic.go:358] "Generic (PLEG): container finished" podID="c715913f-0913-43b6-adde-ddec7d1130f6" containerID="158c347c71c39176cf1672e9348a9df3af09a798bc27674f7416c957b4710b9d" exitCode=0 May 21 11:47:30.942662 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.942299 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c715913f-0913-43b6-adde-ddec7d1130f6","Type":"ContainerDied","Data":"158c347c71c39176cf1672e9348a9df3af09a798bc27674f7416c957b4710b9d"} May 21 11:47:30.942662 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:30.942336 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c715913f-0913-43b6-adde-ddec7d1130f6","Type":"ContainerStarted","Data":"2a304f7495b46818a92c1a78aa20f8d7aef89002adafd9c76abb3ebbd015b159"} May 21 11:47:31.161165 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.161131 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="005f138b-1f25-43b9-a518-cbb7e875cbfc" path="/var/lib/kubelet/pods/005f138b-1f25-43b9-a518-cbb7e875cbfc/volumes" May 21 11:47:31.856578 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.856542 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr"] May 21 11:47:31.858704 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.858688 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:31.862699 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.862655 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 11:47:31.862699 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.862672 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 11:47:31.862699 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.862655 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 11:47:31.863014 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.862995 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 11:47:31.863095 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.863074 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4ltgm\"" May 21 11:47:31.863383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.863354 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 11:47:31.868423 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.868399 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 11:47:31.873927 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.873902 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr"] May 21 11:47:31.949920 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.949881 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c715913f-0913-43b6-adde-ddec7d1130f6","Type":"ContainerStarted","Data":"6627a6a491935c467f7e4680728a1e9295c2b4e310663f4daefd6325a726f293"} May 21 11:47:31.949920 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.949917 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c715913f-0913-43b6-adde-ddec7d1130f6","Type":"ContainerStarted","Data":"5e509c92308afa831641b1d5752854768f1e9ac57a80a68cbfa42e803258141e"} May 21 11:47:31.949920 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.949927 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c715913f-0913-43b6-adde-ddec7d1130f6","Type":"ContainerStarted","Data":"f8b4d1e382d04f24b46e83c56c640abe11825b1ba5498a5c42e4d94bccaed3a5"} May 21 11:47:31.950636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.949935 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c715913f-0913-43b6-adde-ddec7d1130f6","Type":"ContainerStarted","Data":"5dea6d85ddff6957c008ab78db13d49b0b98e69390a9c6e8f220902f0dd70f7b"} May 21 11:47:31.950636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.949943 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c715913f-0913-43b6-adde-ddec7d1130f6","Type":"ContainerStarted","Data":"e76e6013714c1764af35674f2efd5cab3e76e5dbf01f1dfcda1e15f4e152b3c4"} May 21 11:47:31.950636 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.949951 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c715913f-0913-43b6-adde-ddec7d1130f6","Type":"ContainerStarted","Data":"9cd2ad396c008374fb1e3b06f7943adf600b134bc221092687c207e276e19304"} May 21 11:47:31.979570 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:31.979512 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.97949506 podStartE2EDuration="1.97949506s" podCreationTimestamp="2026-05-21 11:47:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:47:31.976704754 +0000 UTC m=+225.405635624" watchObservedRunningTime="2026-05-21 11:47:31.97949506 +0000 UTC m=+225.408425972" May 21 11:47:32.053606 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.053564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.053779 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.053643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-serving-certs-ca-bundle\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.053849 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.053785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-telemeter-client-tls\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.053911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.053891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-metrics-client-ca\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.053994 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.053974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.054029 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.054017 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-secret-telemeter-client\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.054099 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.054060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qccn8\" (UniqueName: \"kubernetes.io/projected/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-kube-api-access-qccn8\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.054165 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.054135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-federate-client-tls\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.154972 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.154881 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-metrics-client-ca\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.154972 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.154923 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.154972 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.154946 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-secret-telemeter-client\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.155309 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.155147 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qccn8\" (UniqueName: \"kubernetes.io/projected/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-kube-api-access-qccn8\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.155309 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.155209 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-federate-client-tls\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.155309 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.155256 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.155476 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.155310 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-serving-certs-ca-bundle\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.155476 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.155368 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-telemeter-client-tls\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.155714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.155679 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-metrics-client-ca\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.155901 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.155871 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.155987 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.155963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-serving-certs-ca-bundle\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.157743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.157724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-secret-telemeter-client\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.158167 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.158130 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-federate-client-tls\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.158378 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.158356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-telemeter-client-tls\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.158447 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.158385 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.164858 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.164832 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qccn8\" (UniqueName: \"kubernetes.io/projected/c7e33e12-6e87-4564-b3c4-f03c15e04fbc-kube-api-access-qccn8\") pod \"telemeter-client-658f8c5fc9-mn6xr\" (UID: \"c7e33e12-6e87-4564-b3c4-f03c15e04fbc\") " pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.170521 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.170495 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" May 21 11:47:32.331258 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.331222 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr"] May 21 11:47:32.333788 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:47:32.333760 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e33e12_6e87_4564_b3c4_f03c15e04fbc.slice/crio-9d5175a218864e9480207c3874de81537fa666555554581092c8e6b85e0ff56e WatchSource:0}: Error finding container 9d5175a218864e9480207c3874de81537fa666555554581092c8e6b85e0ff56e: Status 404 returned error can't find the container with id 9d5175a218864e9480207c3874de81537fa666555554581092c8e6b85e0ff56e May 21 11:47:32.955681 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:32.955638 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" event={"ID":"c7e33e12-6e87-4564-b3c4-f03c15e04fbc","Type":"ContainerStarted","Data":"9d5175a218864e9480207c3874de81537fa666555554581092c8e6b85e0ff56e"} May 21 11:47:33.959867 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:33.959831 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" event={"ID":"c7e33e12-6e87-4564-b3c4-f03c15e04fbc","Type":"ContainerStarted","Data":"28f6a4621964ce16b4c069fe8e7b348e6dffe48ab97221737db0023419e7fa33"} May 21 11:47:33.960404 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:33.959875 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" event={"ID":"c7e33e12-6e87-4564-b3c4-f03c15e04fbc","Type":"ContainerStarted","Data":"ffb80e1079563dec14b53ba3a4911ae670a210e070f56514cabd568c001f0533"} May 21 11:47:34.964293 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:34.964239 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" event={"ID":"c7e33e12-6e87-4564-b3c4-f03c15e04fbc","Type":"ContainerStarted","Data":"2c738c2dc1b54bd26e73abbbb00c8134144d83bb9c8ad2f52e1941505a628772"} May 21 11:47:34.994730 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:34.994672 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-658f8c5fc9-mn6xr" podStartSLOduration=2.53652628 podStartE2EDuration="3.994656936s" podCreationTimestamp="2026-05-21 11:47:31 +0000 UTC" firstStartedPulling="2026-05-21 11:47:32.335733666 +0000 UTC m=+225.764664511" lastFinishedPulling="2026-05-21 11:47:33.793864318 +0000 UTC m=+227.222795167" observedRunningTime="2026-05-21 11:47:34.992101506 +0000 UTC m=+228.421032372" watchObservedRunningTime="2026-05-21 11:47:34.994656936 +0000 UTC m=+228.423587898" May 21 11:47:36.199862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.199826 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f9fc4ddbd-q92pf"] May 21 11:47:36.202195 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.202175 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.214616 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.214591 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9fc4ddbd-q92pf"] May 21 11:47:36.291918 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.291887 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-trusted-ca-bundle\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.292093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.291925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5mqd\" (UniqueName: \"kubernetes.io/projected/9f57c6d4-2807-4cea-8314-d853bb50d71c-kube-api-access-r5mqd\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.292093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.291948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-oauth-config\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.292093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.291972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-oauth-serving-cert\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.292093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.292013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-service-ca\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.292093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.292047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-config\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.292093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.292092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-serving-cert\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.393172 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.393129 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-trusted-ca-bundle\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.393379 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.393179 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5mqd\" (UniqueName: \"kubernetes.io/projected/9f57c6d4-2807-4cea-8314-d853bb50d71c-kube-api-access-r5mqd\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.393379 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.393221 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-oauth-config\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.393379 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.393246 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-oauth-serving-cert\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.393379 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.393313 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-service-ca\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.393379 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.393363 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-config\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.393609 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.393398 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-serving-cert\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.394082 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.394050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-oauth-serving-cert\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.394207 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.394126 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-config\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.394207 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.394152 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-trusted-ca-bundle\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.394207 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.394134 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-service-ca\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.396379 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.396349 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-oauth-config\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.396464 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.396446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-serving-cert\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.402058 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.402038 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5mqd\" (UniqueName: \"kubernetes.io/projected/9f57c6d4-2807-4cea-8314-d853bb50d71c-kube-api-access-r5mqd\") pod \"console-f9fc4ddbd-q92pf\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.512652 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.512574 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:36.649733 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.649705 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9fc4ddbd-q92pf"] May 21 11:47:36.652546 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:47:36.652518 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f57c6d4_2807_4cea_8314_d853bb50d71c.slice/crio-b3dcc533efd03f714002a7fe92b035b5fbdad27e5dac262d05220eec504e331e WatchSource:0}: Error finding container b3dcc533efd03f714002a7fe92b035b5fbdad27e5dac262d05220eec504e331e: Status 404 returned error can't find the container with id b3dcc533efd03f714002a7fe92b035b5fbdad27e5dac262d05220eec504e331e May 21 11:47:36.971995 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.971957 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9fc4ddbd-q92pf" event={"ID":"9f57c6d4-2807-4cea-8314-d853bb50d71c","Type":"ContainerStarted","Data":"2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d"} May 21 11:47:36.971995 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.971996 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9fc4ddbd-q92pf" event={"ID":"9f57c6d4-2807-4cea-8314-d853bb50d71c","Type":"ContainerStarted","Data":"b3dcc533efd03f714002a7fe92b035b5fbdad27e5dac262d05220eec504e331e"} May 21 11:47:36.992670 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:36.992629 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f9fc4ddbd-q92pf" podStartSLOduration=0.99261441 podStartE2EDuration="992.61441ms" podCreationTimestamp="2026-05-21 11:47:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:47:36.991075699 +0000 UTC m=+230.420006567" watchObservedRunningTime="2026-05-21 11:47:36.99261441 +0000 UTC m=+230.421545277" May 21 11:47:46.512760 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:46.512729 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:46.513203 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:46.512772 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:46.517591 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:46.517564 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:47.009673 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:47.009643 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:47:47.062811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:47:47.062774 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c887f465-cwz8b"] May 21 11:48:12.085190 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.085084 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7c887f465-cwz8b" podUID="f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" containerName="console" containerID="cri-o://0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc" gracePeriod=15 May 21 11:48:12.335260 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.335201 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c887f465-cwz8b_f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435/console/0.log" May 21 11:48:12.335409 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.335293 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c887f465-cwz8b" May 21 11:48:12.390359 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390329 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-oauth-config\") pod \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " May 21 11:48:12.390552 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390391 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-trusted-ca-bundle\") pod \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " May 21 11:48:12.390552 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390448 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-service-ca\") pod \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " May 21 11:48:12.390552 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390485 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-oauth-serving-cert\") pod \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " May 21 11:48:12.390552 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390518 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-serving-cert\") pod \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " May 21 11:48:12.390750 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390567 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-config\") pod \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " May 21 11:48:12.390750 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390592 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kn68\" (UniqueName: \"kubernetes.io/projected/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-kube-api-access-4kn68\") pod \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\" (UID: \"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435\") " May 21 11:48:12.390898 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390867 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" (UID: "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:48:12.390966 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390908 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" (UID: "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:48:12.390966 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390921 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" (UID: "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:48:12.390966 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.390949 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-config" (OuterVolumeSpecName: "console-config") pod "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" (UID: "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:48:12.392724 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.392694 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" (UID: "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:48:12.392844 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.392755 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" (UID: "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:48:12.392921 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.392876 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-kube-api-access-4kn68" (OuterVolumeSpecName: "kube-api-access-4kn68") pod "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" (UID: "f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435"). InnerVolumeSpecName "kube-api-access-4kn68". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:48:12.491576 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.491521 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-trusted-ca-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:48:12.491765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.491592 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-service-ca\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:48:12.491765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.491609 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-oauth-serving-cert\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:48:12.491765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.491624 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-serving-cert\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:48:12.491765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.491639 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:48:12.491765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.491652 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kn68\" (UniqueName: \"kubernetes.io/projected/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-kube-api-access-4kn68\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:48:12.491765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:12.491664 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435-console-oauth-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:48:13.083885 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.083852 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c887f465-cwz8b_f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435/console/0.log" May 21 11:48:13.084068 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.083899 2565 generic.go:358] "Generic (PLEG): container finished" podID="f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" containerID="0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc" exitCode=2 May 21 11:48:13.084068 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.083964 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c887f465-cwz8b" May 21 11:48:13.084068 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.083987 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c887f465-cwz8b" event={"ID":"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435","Type":"ContainerDied","Data":"0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc"} May 21 11:48:13.084068 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.084024 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c887f465-cwz8b" event={"ID":"f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435","Type":"ContainerDied","Data":"22b7554d8acbd2d6b1f5595c7a7fe22ae042cd845d696be77938bc130ac8b1a5"} May 21 11:48:13.084068 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.084039 2565 scope.go:117] "RemoveContainer" containerID="0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc" May 21 11:48:13.092546 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.092414 2565 scope.go:117] "RemoveContainer" containerID="0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc" May 21 11:48:13.092746 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:48:13.092684 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc\": container with ID starting with 0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc not found: ID does not exist" containerID="0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc" May 21 11:48:13.092746 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.092708 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc"} err="failed to get container status \"0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc\": rpc error: code = NotFound desc = could not find container \"0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc\": container with ID starting with 0adfeb0f4580f5cf4bb2d8b04c66cd769d30cecbfe059f6c6e202f82e0093ebc not found: ID does not exist" May 21 11:48:13.105023 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.104996 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c887f465-cwz8b"] May 21 11:48:13.108742 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.108720 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c887f465-cwz8b"] May 21 11:48:13.161223 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:13.161195 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" path="/var/lib/kubelet/pods/f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435/volumes" May 21 11:48:42.525833 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.525795 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75958b989d-zmvt4"] May 21 11:48:42.526353 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.526156 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" containerName="console" May 21 11:48:42.526353 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.526171 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" containerName="console" May 21 11:48:42.526353 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.526246 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6c1e6e9-02f3-49ed-97ce-0fcb1d46d435" containerName="console" May 21 11:48:42.529367 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.529342 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.542161 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.542129 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75958b989d-zmvt4"] May 21 11:48:42.545154 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.545127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-service-ca\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.545317 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.545193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-serving-cert\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.545317 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.545266 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-trusted-ca-bundle\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.545418 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.545357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-config\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.545418 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.545406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-oauth-config\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.545490 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.545434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-oauth-serving-cert\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.545490 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.545460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggs9q\" (UniqueName: \"kubernetes.io/projected/fb2a816c-1f49-4b4d-8c82-650ca95ff392-kube-api-access-ggs9q\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.646193 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.646157 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-serving-cert\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.646417 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.646205 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-trusted-ca-bundle\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.646417 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.646345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-config\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.646417 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.646386 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-oauth-config\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.646586 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.646424 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-oauth-serving-cert\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.646586 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.646448 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggs9q\" (UniqueName: \"kubernetes.io/projected/fb2a816c-1f49-4b4d-8c82-650ca95ff392-kube-api-access-ggs9q\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.646586 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.646486 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-service-ca\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.647208 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.647180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-config\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.647321 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.647218 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-service-ca\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.647321 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.647218 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-trusted-ca-bundle\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.647321 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.647191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-oauth-serving-cert\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.649585 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.649552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-oauth-config\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.649675 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.649623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-serving-cert\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.655478 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.655458 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggs9q\" (UniqueName: \"kubernetes.io/projected/fb2a816c-1f49-4b4d-8c82-650ca95ff392-kube-api-access-ggs9q\") pod \"console-75958b989d-zmvt4\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.839472 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.839441 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:42.972775 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:42.972614 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75958b989d-zmvt4"] May 21 11:48:42.975651 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:48:42.975626 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2a816c_1f49_4b4d_8c82_650ca95ff392.slice/crio-eb755542e54af432bbe513fd345c38b47e7706e9b372ef5f846dfdbd98ebc8d7 WatchSource:0}: Error finding container eb755542e54af432bbe513fd345c38b47e7706e9b372ef5f846dfdbd98ebc8d7: Status 404 returned error can't find the container with id eb755542e54af432bbe513fd345c38b47e7706e9b372ef5f846dfdbd98ebc8d7 May 21 11:48:43.173536 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:43.173440 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75958b989d-zmvt4" event={"ID":"fb2a816c-1f49-4b4d-8c82-650ca95ff392","Type":"ContainerStarted","Data":"76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4"} May 21 11:48:43.173536 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:43.173486 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75958b989d-zmvt4" event={"ID":"fb2a816c-1f49-4b4d-8c82-650ca95ff392","Type":"ContainerStarted","Data":"eb755542e54af432bbe513fd345c38b47e7706e9b372ef5f846dfdbd98ebc8d7"} May 21 11:48:43.191563 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:43.191513 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75958b989d-zmvt4" podStartSLOduration=1.191494977 podStartE2EDuration="1.191494977s" podCreationTimestamp="2026-05-21 11:48:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:48:43.19115939 +0000 UTC m=+296.620090263" watchObservedRunningTime="2026-05-21 11:48:43.191494977 +0000 UTC m=+296.620425847" May 21 11:48:47.016673 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:47.016638 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:48:47.017862 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:47.017839 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:48:47.021988 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:47.021961 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:48:47.023047 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:47.023021 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:48:47.026970 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:47.026951 2565 kubelet.go:1628] "Image garbage collection succeeded" May 21 11:48:52.840613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:52.840569 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:52.840613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:52.840611 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:52.845475 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:52.845454 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:53.207298 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:53.207196 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75958b989d-zmvt4" May 21 11:48:53.255738 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:48:53.255703 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9fc4ddbd-q92pf"] May 21 11:49:13.736654 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.736612 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-n62nl"] May 21 11:49:13.740176 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.740152 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.742517 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.742494 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 11:49:13.746184 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.746163 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n62nl"] May 21 11:49:13.817368 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.817334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b458a50b-76f7-4a45-878d-3d4d08769841-original-pull-secret\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.817568 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.817391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b458a50b-76f7-4a45-878d-3d4d08769841-kubelet-config\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.817568 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.817470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b458a50b-76f7-4a45-878d-3d4d08769841-dbus\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.918582 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.918530 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b458a50b-76f7-4a45-878d-3d4d08769841-original-pull-secret\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.918582 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.918592 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b458a50b-76f7-4a45-878d-3d4d08769841-kubelet-config\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.918823 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.918642 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b458a50b-76f7-4a45-878d-3d4d08769841-dbus\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.918823 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.918748 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b458a50b-76f7-4a45-878d-3d4d08769841-kubelet-config\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.918924 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.918826 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b458a50b-76f7-4a45-878d-3d4d08769841-dbus\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:13.921041 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:13.921019 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b458a50b-76f7-4a45-878d-3d4d08769841-original-pull-secret\") pod \"global-pull-secret-syncer-n62nl\" (UID: \"b458a50b-76f7-4a45-878d-3d4d08769841\") " pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:14.050059 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:14.049977 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n62nl" May 21 11:49:14.184310 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:14.184256 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n62nl"] May 21 11:49:14.187638 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:49:14.187610 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb458a50b_76f7_4a45_878d_3d4d08769841.slice/crio-42d73ed82a738f04341846ecf68068ec389e3d84311cda09d031dcfe18e5a56f WatchSource:0}: Error finding container 42d73ed82a738f04341846ecf68068ec389e3d84311cda09d031dcfe18e5a56f: Status 404 returned error can't find the container with id 42d73ed82a738f04341846ecf68068ec389e3d84311cda09d031dcfe18e5a56f May 21 11:49:14.189359 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:14.189341 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:49:14.262222 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:14.262185 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n62nl" event={"ID":"b458a50b-76f7-4a45-878d-3d4d08769841","Type":"ContainerStarted","Data":"42d73ed82a738f04341846ecf68068ec389e3d84311cda09d031dcfe18e5a56f"} May 21 11:49:18.276975 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.276853 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f9fc4ddbd-q92pf" podUID="9f57c6d4-2807-4cea-8314-d853bb50d71c" containerName="console" containerID="cri-o://2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d" gracePeriod=15 May 21 11:49:18.279136 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.279108 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n62nl" event={"ID":"b458a50b-76f7-4a45-878d-3d4d08769841","Type":"ContainerStarted","Data":"d8b33c44a3fb4e7b4580cb27ff24453de839adc3a3b59fc3d007d424b7ec04e4"} May 21 11:49:18.293961 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.293911 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n62nl" podStartSLOduration=1.581321558 podStartE2EDuration="5.293895539s" podCreationTimestamp="2026-05-21 11:49:13 +0000 UTC" firstStartedPulling="2026-05-21 11:49:14.189482768 +0000 UTC m=+327.618413613" lastFinishedPulling="2026-05-21 11:49:17.902056748 +0000 UTC m=+331.330987594" observedRunningTime="2026-05-21 11:49:18.29365089 +0000 UTC m=+331.722581759" watchObservedRunningTime="2026-05-21 11:49:18.293895539 +0000 UTC m=+331.722826408" May 21 11:49:18.523687 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.523661 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f9fc4ddbd-q92pf_9f57c6d4-2807-4cea-8314-d853bb50d71c/console/0.log" May 21 11:49:18.523810 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.523724 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:49:18.664386 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664348 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-trusted-ca-bundle\") pod \"9f57c6d4-2807-4cea-8314-d853bb50d71c\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " May 21 11:49:18.664386 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664389 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5mqd\" (UniqueName: \"kubernetes.io/projected/9f57c6d4-2807-4cea-8314-d853bb50d71c-kube-api-access-r5mqd\") pod \"9f57c6d4-2807-4cea-8314-d853bb50d71c\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " May 21 11:49:18.664608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664406 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-serving-cert\") pod \"9f57c6d4-2807-4cea-8314-d853bb50d71c\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " May 21 11:49:18.664608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664449 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-service-ca\") pod \"9f57c6d4-2807-4cea-8314-d853bb50d71c\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " May 21 11:49:18.664608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664506 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-oauth-serving-cert\") pod \"9f57c6d4-2807-4cea-8314-d853bb50d71c\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " May 21 11:49:18.664608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664535 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-oauth-config\") pod \"9f57c6d4-2807-4cea-8314-d853bb50d71c\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " May 21 11:49:18.664608 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664607 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-config\") pod \"9f57c6d4-2807-4cea-8314-d853bb50d71c\" (UID: \"9f57c6d4-2807-4cea-8314-d853bb50d71c\") " May 21 11:49:18.664991 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664958 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9f57c6d4-2807-4cea-8314-d853bb50d71c" (UID: "9f57c6d4-2807-4cea-8314-d853bb50d71c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:49:18.664991 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664974 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-service-ca" (OuterVolumeSpecName: "service-ca") pod "9f57c6d4-2807-4cea-8314-d853bb50d71c" (UID: "9f57c6d4-2807-4cea-8314-d853bb50d71c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:49:18.665163 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.664957 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9f57c6d4-2807-4cea-8314-d853bb50d71c" (UID: "9f57c6d4-2807-4cea-8314-d853bb50d71c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:49:18.665337 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.665311 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-config" (OuterVolumeSpecName: "console-config") pod "9f57c6d4-2807-4cea-8314-d853bb50d71c" (UID: "9f57c6d4-2807-4cea-8314-d853bb50d71c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:49:18.666773 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.666752 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f57c6d4-2807-4cea-8314-d853bb50d71c-kube-api-access-r5mqd" (OuterVolumeSpecName: "kube-api-access-r5mqd") pod "9f57c6d4-2807-4cea-8314-d853bb50d71c" (UID: "9f57c6d4-2807-4cea-8314-d853bb50d71c"). InnerVolumeSpecName "kube-api-access-r5mqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:49:18.666938 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.666915 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9f57c6d4-2807-4cea-8314-d853bb50d71c" (UID: "9f57c6d4-2807-4cea-8314-d853bb50d71c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:49:18.667021 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.667004 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9f57c6d4-2807-4cea-8314-d853bb50d71c" (UID: "9f57c6d4-2807-4cea-8314-d853bb50d71c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:49:18.766093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.766052 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-trusted-ca-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:49:18.766093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.766085 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5mqd\" (UniqueName: \"kubernetes.io/projected/9f57c6d4-2807-4cea-8314-d853bb50d71c-kube-api-access-r5mqd\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:49:18.766093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.766094 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-serving-cert\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:49:18.766093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.766103 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-service-ca\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:49:18.766383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.766112 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-oauth-serving-cert\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:49:18.766383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.766121 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-oauth-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:49:18.766383 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:18.766130 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f57c6d4-2807-4cea-8314-d853bb50d71c-console-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:49:19.283035 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.283008 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f9fc4ddbd-q92pf_9f57c6d4-2807-4cea-8314-d853bb50d71c/console/0.log" May 21 11:49:19.283527 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.283055 2565 generic.go:358] "Generic (PLEG): container finished" podID="9f57c6d4-2807-4cea-8314-d853bb50d71c" containerID="2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d" exitCode=2 May 21 11:49:19.283527 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.283139 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9fc4ddbd-q92pf" May 21 11:49:19.283527 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.283142 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9fc4ddbd-q92pf" event={"ID":"9f57c6d4-2807-4cea-8314-d853bb50d71c","Type":"ContainerDied","Data":"2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d"} May 21 11:49:19.283527 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.283239 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9fc4ddbd-q92pf" event={"ID":"9f57c6d4-2807-4cea-8314-d853bb50d71c","Type":"ContainerDied","Data":"b3dcc533efd03f714002a7fe92b035b5fbdad27e5dac262d05220eec504e331e"} May 21 11:49:19.283527 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.283255 2565 scope.go:117] "RemoveContainer" containerID="2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d" May 21 11:49:19.291847 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.291825 2565 scope.go:117] "RemoveContainer" containerID="2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d" May 21 11:49:19.292111 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:49:19.292091 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d\": container with ID starting with 2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d not found: ID does not exist" containerID="2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d" May 21 11:49:19.292164 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.292121 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d"} err="failed to get container status \"2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d\": rpc error: code = NotFound desc = could not find container \"2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d\": container with ID starting with 2bc5c7edfe5508ccff1ebdc629a425abf3d41f5e86ba19b8c3cb3d5bc4f0ca6d not found: ID does not exist" May 21 11:49:19.301815 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.301789 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9fc4ddbd-q92pf"] May 21 11:49:19.305553 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:19.305531 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f9fc4ddbd-q92pf"] May 21 11:49:21.160817 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:49:21.160785 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f57c6d4-2807-4cea-8314-d853bb50d71c" path="/var/lib/kubelet/pods/9f57c6d4-2807-4cea-8314-d853bb50d71c/volumes" May 21 11:50:14.966351 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.966301 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn"] May 21 11:50:14.966755 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.966641 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f57c6d4-2807-4cea-8314-d853bb50d71c" containerName="console" May 21 11:50:14.966755 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.966655 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f57c6d4-2807-4cea-8314-d853bb50d71c" containerName="console" May 21 11:50:14.966755 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.966714 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f57c6d4-2807-4cea-8314-d853bb50d71c" containerName="console" May 21 11:50:14.969839 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.969821 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:14.972784 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.972762 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 11:50:14.973049 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.973033 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 11:50:14.974027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.974009 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-db7kr\"" May 21 11:50:14.983982 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:14.983960 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn"] May 21 11:50:15.054470 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.054435 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdf5f\" (UniqueName: \"kubernetes.io/projected/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-kube-api-access-wdf5f\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.054644 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.054483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.054644 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.054579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.155981 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.155933 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdf5f\" (UniqueName: \"kubernetes.io/projected/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-kube-api-access-wdf5f\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.156169 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.155999 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.156169 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.156045 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.156458 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.156435 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.156530 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.156496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.165548 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.165517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdf5f\" (UniqueName: \"kubernetes.io/projected/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-kube-api-access-wdf5f\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.279842 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.279749 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:15.410352 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.410251 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn"] May 21 11:50:15.412665 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:50:15.412639 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a98dc9_d6d5_4c23_9e71_5c22ff5958bf.slice/crio-fb741ca05bf28b5ef980e7d69a2f436da9e3caa060f4974757336ff556a0ac8d WatchSource:0}: Error finding container fb741ca05bf28b5ef980e7d69a2f436da9e3caa060f4974757336ff556a0ac8d: Status 404 returned error can't find the container with id fb741ca05bf28b5ef980e7d69a2f436da9e3caa060f4974757336ff556a0ac8d May 21 11:50:15.449656 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:15.449618 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" event={"ID":"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf","Type":"ContainerStarted","Data":"fb741ca05bf28b5ef980e7d69a2f436da9e3caa060f4974757336ff556a0ac8d"} May 21 11:50:23.477593 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:23.477555 2565 generic.go:358] "Generic (PLEG): container finished" podID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerID="9734231950d5a83eee2e9f20253b473fe4ef285436b94526eaca0f36395853e9" exitCode=0 May 21 11:50:23.477994 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:23.477627 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" event={"ID":"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf","Type":"ContainerDied","Data":"9734231950d5a83eee2e9f20253b473fe4ef285436b94526eaca0f36395853e9"} May 21 11:50:26.488339 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:26.488300 2565 generic.go:358] "Generic (PLEG): container finished" podID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerID="9bfec1f27f7fe24c478afd99115ce73403085a76c41c6685f0ba940c66eb9ab8" exitCode=0 May 21 11:50:26.488721 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:26.488381 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" event={"ID":"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf","Type":"ContainerDied","Data":"9bfec1f27f7fe24c478afd99115ce73403085a76c41c6685f0ba940c66eb9ab8"} May 21 11:50:35.516785 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:35.516750 2565 generic.go:358] "Generic (PLEG): container finished" podID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerID="f93be767969f77caf67dffd5cb70d7f522b2f1f514921f44538c5f64d560f0c7" exitCode=0 May 21 11:50:35.516785 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:35.516791 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" event={"ID":"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf","Type":"ContainerDied","Data":"f93be767969f77caf67dffd5cb70d7f522b2f1f514921f44538c5f64d560f0c7"} May 21 11:50:36.651622 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.651598 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:36.757021 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.756991 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-bundle\") pod \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " May 21 11:50:36.757203 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.757099 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdf5f\" (UniqueName: \"kubernetes.io/projected/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-kube-api-access-wdf5f\") pod \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " May 21 11:50:36.757203 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.757139 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-util\") pod \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\" (UID: \"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf\") " May 21 11:50:36.757823 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.757801 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-bundle" (OuterVolumeSpecName: "bundle") pod "47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" (UID: "47a98dc9-d6d5-4c23-9e71-5c22ff5958bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:50:36.759488 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.759464 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-kube-api-access-wdf5f" (OuterVolumeSpecName: "kube-api-access-wdf5f") pod "47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" (UID: "47a98dc9-d6d5-4c23-9e71-5c22ff5958bf"). InnerVolumeSpecName "kube-api-access-wdf5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:50:36.761992 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.761964 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-util" (OuterVolumeSpecName: "util") pod "47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" (UID: "47a98dc9-d6d5-4c23-9e71-5c22ff5958bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:50:36.857942 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.857914 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:50:36.857942 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.857942 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdf5f\" (UniqueName: \"kubernetes.io/projected/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-kube-api-access-wdf5f\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:50:36.858121 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:36.857953 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a98dc9-d6d5-4c23-9e71-5c22ff5958bf-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:50:37.524397 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:37.524312 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" May 21 11:50:37.524397 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:37.524319 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwqzdn" event={"ID":"47a98dc9-d6d5-4c23-9e71-5c22ff5958bf","Type":"ContainerDied","Data":"fb741ca05bf28b5ef980e7d69a2f436da9e3caa060f4974757336ff556a0ac8d"} May 21 11:50:37.524397 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:37.524350 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb741ca05bf28b5ef980e7d69a2f436da9e3caa060f4974757336ff556a0ac8d" May 21 11:50:47.825648 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.825611 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x"] May 21 11:50:47.826022 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.825900 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerName="extract" May 21 11:50:47.826022 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.825911 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerName="extract" May 21 11:50:47.826022 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.825930 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerName="pull" May 21 11:50:47.826022 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.825935 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerName="pull" May 21 11:50:47.826022 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.825944 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerName="util" May 21 11:50:47.826022 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.825949 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerName="util" May 21 11:50:47.826022 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.825995 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="47a98dc9-d6d5-4c23-9e71-5c22ff5958bf" containerName="extract" May 21 11:50:47.828418 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.828401 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:47.830855 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.830834 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 11:50:47.830983 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.830839 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-db7kr\"" May 21 11:50:47.830983 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.830839 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 11:50:47.836329 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.836304 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x"] May 21 11:50:47.954774 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.954727 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:47.954972 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.954813 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqpqs\" (UniqueName: \"kubernetes.io/projected/e273ccda-3d04-4990-baef-3f1f741c164a-kube-api-access-sqpqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:47.954972 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:47.954839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:48.056217 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.056173 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqpqs\" (UniqueName: \"kubernetes.io/projected/e273ccda-3d04-4990-baef-3f1f741c164a-kube-api-access-sqpqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:48.056217 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.056220 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:48.056506 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.056344 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:48.056693 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.056673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:48.056758 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.056702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:48.064884 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.064864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqpqs\" (UniqueName: \"kubernetes.io/projected/e273ccda-3d04-4990-baef-3f1f741c164a-kube-api-access-sqpqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:48.138954 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.138856 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:48.266141 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.266108 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x"] May 21 11:50:48.269348 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:50:48.269309 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode273ccda_3d04_4990_baef_3f1f741c164a.slice/crio-e4c653d58aaef2d1e5e3b9204ad19e367f95e79b89a6ceab88af8ee081283937 WatchSource:0}: Error finding container e4c653d58aaef2d1e5e3b9204ad19e367f95e79b89a6ceab88af8ee081283937: Status 404 returned error can't find the container with id e4c653d58aaef2d1e5e3b9204ad19e367f95e79b89a6ceab88af8ee081283937 May 21 11:50:48.557240 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.557150 2565 generic.go:358] "Generic (PLEG): container finished" podID="e273ccda-3d04-4990-baef-3f1f741c164a" containerID="932fe1a002a0b8d31949672d3b67c8be51addcff14c675568f54435558e21066" exitCode=0 May 21 11:50:48.557240 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.557199 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" event={"ID":"e273ccda-3d04-4990-baef-3f1f741c164a","Type":"ContainerDied","Data":"932fe1a002a0b8d31949672d3b67c8be51addcff14c675568f54435558e21066"} May 21 11:50:48.557240 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:48.557219 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" event={"ID":"e273ccda-3d04-4990-baef-3f1f741c164a","Type":"ContainerStarted","Data":"e4c653d58aaef2d1e5e3b9204ad19e367f95e79b89a6ceab88af8ee081283937"} May 21 11:50:51.568306 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:51.568246 2565 generic.go:358] "Generic (PLEG): container finished" podID="e273ccda-3d04-4990-baef-3f1f741c164a" containerID="a85c5924c17291fffda4b36eeaf2eccbbb999bbcf21ee0f32d410e7409a18d76" exitCode=0 May 21 11:50:51.568740 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:51.568307 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" event={"ID":"e273ccda-3d04-4990-baef-3f1f741c164a","Type":"ContainerDied","Data":"a85c5924c17291fffda4b36eeaf2eccbbb999bbcf21ee0f32d410e7409a18d76"} May 21 11:50:52.573217 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:52.573182 2565 generic.go:358] "Generic (PLEG): container finished" podID="e273ccda-3d04-4990-baef-3f1f741c164a" containerID="c24f4d1339e7a25a3e1f625fcbe44a9c4454a76a5091dc29e7d7f661d6a021bf" exitCode=0 May 21 11:50:52.573654 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:52.573286 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" event={"ID":"e273ccda-3d04-4990-baef-3f1f741c164a","Type":"ContainerDied","Data":"c24f4d1339e7a25a3e1f625fcbe44a9c4454a76a5091dc29e7d7f661d6a021bf"} May 21 11:50:53.701979 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.701955 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:53.808536 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.808491 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqpqs\" (UniqueName: \"kubernetes.io/projected/e273ccda-3d04-4990-baef-3f1f741c164a-kube-api-access-sqpqs\") pod \"e273ccda-3d04-4990-baef-3f1f741c164a\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " May 21 11:50:53.808737 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.808602 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-util\") pod \"e273ccda-3d04-4990-baef-3f1f741c164a\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " May 21 11:50:53.808737 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.808640 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-bundle\") pod \"e273ccda-3d04-4990-baef-3f1f741c164a\" (UID: \"e273ccda-3d04-4990-baef-3f1f741c164a\") " May 21 11:50:53.809037 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.809003 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-bundle" (OuterVolumeSpecName: "bundle") pod "e273ccda-3d04-4990-baef-3f1f741c164a" (UID: "e273ccda-3d04-4990-baef-3f1f741c164a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:50:53.810797 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.810774 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e273ccda-3d04-4990-baef-3f1f741c164a-kube-api-access-sqpqs" (OuterVolumeSpecName: "kube-api-access-sqpqs") pod "e273ccda-3d04-4990-baef-3f1f741c164a" (UID: "e273ccda-3d04-4990-baef-3f1f741c164a"). InnerVolumeSpecName "kube-api-access-sqpqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:50:53.812811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.812778 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-util" (OuterVolumeSpecName: "util") pod "e273ccda-3d04-4990-baef-3f1f741c164a" (UID: "e273ccda-3d04-4990-baef-3f1f741c164a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:50:53.909911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.909814 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqpqs\" (UniqueName: \"kubernetes.io/projected/e273ccda-3d04-4990-baef-3f1f741c164a-kube-api-access-sqpqs\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:50:53.909911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.909849 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:50:53.909911 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:53.909859 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e273ccda-3d04-4990-baef-3f1f741c164a-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:50:54.162462 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.162385 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-qcgtj"] May 21 11:50:54.162696 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.162684 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e273ccda-3d04-4990-baef-3f1f741c164a" containerName="extract" May 21 11:50:54.162738 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.162698 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e273ccda-3d04-4990-baef-3f1f741c164a" containerName="extract" May 21 11:50:54.162738 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.162709 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e273ccda-3d04-4990-baef-3f1f741c164a" containerName="util" May 21 11:50:54.162738 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.162717 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e273ccda-3d04-4990-baef-3f1f741c164a" containerName="util" May 21 11:50:54.162738 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.162724 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e273ccda-3d04-4990-baef-3f1f741c164a" containerName="pull" May 21 11:50:54.162738 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.162729 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e273ccda-3d04-4990-baef-3f1f741c164a" containerName="pull" May 21 11:50:54.162871 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.162789 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e273ccda-3d04-4990-baef-3f1f741c164a" containerName="extract" May 21 11:50:54.165813 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.165797 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" May 21 11:50:54.168519 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.168495 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 11:50:54.168635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.168519 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 11:50:54.168635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.168498 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6d9bf\"" May 21 11:50:54.173223 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.173204 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-qcgtj"] May 21 11:50:54.313155 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.313120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7l7\" (UniqueName: \"kubernetes.io/projected/e6e641ce-9973-4db2-a6da-c08204e1df59-kube-api-access-sb7l7\") pod \"cert-manager-cainjector-68b757865b-qcgtj\" (UID: \"e6e641ce-9973-4db2-a6da-c08204e1df59\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" May 21 11:50:54.313350 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.313174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e641ce-9973-4db2-a6da-c08204e1df59-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-qcgtj\" (UID: \"e6e641ce-9973-4db2-a6da-c08204e1df59\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" May 21 11:50:54.413807 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.413730 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7l7\" (UniqueName: \"kubernetes.io/projected/e6e641ce-9973-4db2-a6da-c08204e1df59-kube-api-access-sb7l7\") pod \"cert-manager-cainjector-68b757865b-qcgtj\" (UID: \"e6e641ce-9973-4db2-a6da-c08204e1df59\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" May 21 11:50:54.413807 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.413789 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e641ce-9973-4db2-a6da-c08204e1df59-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-qcgtj\" (UID: \"e6e641ce-9973-4db2-a6da-c08204e1df59\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" May 21 11:50:54.422301 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.422244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e641ce-9973-4db2-a6da-c08204e1df59-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-qcgtj\" (UID: \"e6e641ce-9973-4db2-a6da-c08204e1df59\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" May 21 11:50:54.422624 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.422601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7l7\" (UniqueName: \"kubernetes.io/projected/e6e641ce-9973-4db2-a6da-c08204e1df59-kube-api-access-sb7l7\") pod \"cert-manager-cainjector-68b757865b-qcgtj\" (UID: \"e6e641ce-9973-4db2-a6da-c08204e1df59\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" May 21 11:50:54.487720 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.487668 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" May 21 11:50:54.589185 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.589141 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" event={"ID":"e273ccda-3d04-4990-baef-3f1f741c164a","Type":"ContainerDied","Data":"e4c653d58aaef2d1e5e3b9204ad19e367f95e79b89a6ceab88af8ee081283937"} May 21 11:50:54.589185 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.589189 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4c653d58aaef2d1e5e3b9204ad19e367f95e79b89a6ceab88af8ee081283937" May 21 11:50:54.589445 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.589206 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvns6x" May 21 11:50:54.618253 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:54.618223 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-qcgtj"] May 21 11:50:54.621020 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:50:54.620997 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6e641ce_9973_4db2_a6da_c08204e1df59.slice/crio-fea1e41180eb689e79a07e375267cfc42b192f05c5ca2aead3164c34cc6b8a1c WatchSource:0}: Error finding container fea1e41180eb689e79a07e375267cfc42b192f05c5ca2aead3164c34cc6b8a1c: Status 404 returned error can't find the container with id fea1e41180eb689e79a07e375267cfc42b192f05c5ca2aead3164c34cc6b8a1c May 21 11:50:55.594288 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:55.594243 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" event={"ID":"e6e641ce-9973-4db2-a6da-c08204e1df59","Type":"ContainerStarted","Data":"fea1e41180eb689e79a07e375267cfc42b192f05c5ca2aead3164c34cc6b8a1c"} May 21 11:50:57.602209 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:57.602170 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" event={"ID":"e6e641ce-9973-4db2-a6da-c08204e1df59","Type":"ContainerStarted","Data":"e6f8b21f540c66483e88fa8323adeda2f82d537623116118539bdd08248d8368"} May 21 11:50:57.618427 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:50:57.618378 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-qcgtj" podStartSLOduration=1.306332793 podStartE2EDuration="3.618363283s" podCreationTimestamp="2026-05-21 11:50:54 +0000 UTC" firstStartedPulling="2026-05-21 11:50:54.622828792 +0000 UTC m=+428.051759642" lastFinishedPulling="2026-05-21 11:50:56.934859275 +0000 UTC m=+430.363790132" observedRunningTime="2026-05-21 11:50:57.617852632 +0000 UTC m=+431.046783499" watchObservedRunningTime="2026-05-21 11:50:57.618363283 +0000 UTC m=+431.047294162" May 21 11:51:05.053400 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.053317 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb"] May 21 11:51:05.063283 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.063251 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" May 21 11:51:05.063991 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.063967 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb"] May 21 11:51:05.065938 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.065917 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 11:51:05.066107 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.066081 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 11:51:05.067225 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.067208 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rwz7t\"" May 21 11:51:05.107715 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.107680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdwbj\" (UniqueName: \"kubernetes.io/projected/2e30d937-cef6-4a82-8b3f-f5e9b41c83f2-kube-api-access-sdwbj\") pod \"openshift-lws-operator-bfc7f696d-752rb\" (UID: \"2e30d937-cef6-4a82-8b3f-f5e9b41c83f2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" May 21 11:51:05.107854 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.107764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e30d937-cef6-4a82-8b3f-f5e9b41c83f2-tmp\") pod \"openshift-lws-operator-bfc7f696d-752rb\" (UID: \"2e30d937-cef6-4a82-8b3f-f5e9b41c83f2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" May 21 11:51:05.209013 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.208980 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e30d937-cef6-4a82-8b3f-f5e9b41c83f2-tmp\") pod \"openshift-lws-operator-bfc7f696d-752rb\" (UID: \"2e30d937-cef6-4a82-8b3f-f5e9b41c83f2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" May 21 11:51:05.209193 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.209049 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdwbj\" (UniqueName: \"kubernetes.io/projected/2e30d937-cef6-4a82-8b3f-f5e9b41c83f2-kube-api-access-sdwbj\") pod \"openshift-lws-operator-bfc7f696d-752rb\" (UID: \"2e30d937-cef6-4a82-8b3f-f5e9b41c83f2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" May 21 11:51:05.209523 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.209496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e30d937-cef6-4a82-8b3f-f5e9b41c83f2-tmp\") pod \"openshift-lws-operator-bfc7f696d-752rb\" (UID: \"2e30d937-cef6-4a82-8b3f-f5e9b41c83f2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" May 21 11:51:05.220031 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.220012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdwbj\" (UniqueName: \"kubernetes.io/projected/2e30d937-cef6-4a82-8b3f-f5e9b41c83f2-kube-api-access-sdwbj\") pod \"openshift-lws-operator-bfc7f696d-752rb\" (UID: \"2e30d937-cef6-4a82-8b3f-f5e9b41c83f2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" May 21 11:51:05.379838 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.379803 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" May 21 11:51:05.510673 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.510572 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb"] May 21 11:51:05.513608 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:05.513572 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e30d937_cef6_4a82_8b3f_f5e9b41c83f2.slice/crio-8532f5e767fca79bf8ce099ddd7d5c6e7fb404a2a2b563c9f09531f3b72ae0d9 WatchSource:0}: Error finding container 8532f5e767fca79bf8ce099ddd7d5c6e7fb404a2a2b563c9f09531f3b72ae0d9: Status 404 returned error can't find the container with id 8532f5e767fca79bf8ce099ddd7d5c6e7fb404a2a2b563c9f09531f3b72ae0d9 May 21 11:51:05.633575 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:05.633468 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" event={"ID":"2e30d937-cef6-4a82-8b3f-f5e9b41c83f2","Type":"ContainerStarted","Data":"8532f5e767fca79bf8ce099ddd7d5c6e7fb404a2a2b563c9f09531f3b72ae0d9"} May 21 11:51:08.647840 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:08.647797 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" event={"ID":"2e30d937-cef6-4a82-8b3f-f5e9b41c83f2","Type":"ContainerStarted","Data":"abea2f5e008c98a95892fe47f3f9692c966e7a41741eabb27919813ef30a4322"} May 21 11:51:08.665991 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:08.665929 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-752rb" podStartSLOduration=0.948624859 podStartE2EDuration="3.665908883s" podCreationTimestamp="2026-05-21 11:51:05 +0000 UTC" firstStartedPulling="2026-05-21 11:51:05.514953638 +0000 UTC m=+438.943884484" lastFinishedPulling="2026-05-21 11:51:08.232237662 +0000 UTC m=+441.661168508" observedRunningTime="2026-05-21 11:51:08.664332486 +0000 UTC m=+442.093263354" watchObservedRunningTime="2026-05-21 11:51:08.665908883 +0000 UTC m=+442.094839752" May 21 11:51:12.825055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.825012 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7"] May 21 11:51:12.827583 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.827563 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.830523 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.830439 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 11:51:12.830523 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.830446 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 11:51:12.831602 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.831585 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-db7kr\"" May 21 11:51:12.838706 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.838683 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7"] May 21 11:51:12.877065 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.877026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csb6l\" (UniqueName: \"kubernetes.io/projected/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-kube-api-access-csb6l\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.877065 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.877071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.877328 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.877188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.978599 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.978559 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.978789 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.978626 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-csb6l\" (UniqueName: \"kubernetes.io/projected/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-kube-api-access-csb6l\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.978789 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.978658 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.978973 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.978951 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.978973 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.978965 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:12.989340 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:12.989303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csb6l\" (UniqueName: \"kubernetes.io/projected/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-kube-api-access-csb6l\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:13.137472 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:13.137373 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:13.272905 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:13.272813 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7"] May 21 11:51:13.275766 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:13.275733 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod938e79e8_41d8_4ee5_b76b_57db2ecc2b00.slice/crio-d43275892de127f3166b564502ec729643161845f56087eb4236e504aa244e47 WatchSource:0}: Error finding container d43275892de127f3166b564502ec729643161845f56087eb4236e504aa244e47: Status 404 returned error can't find the container with id d43275892de127f3166b564502ec729643161845f56087eb4236e504aa244e47 May 21 11:51:13.665855 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:13.665816 2565 generic.go:358] "Generic (PLEG): container finished" podID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerID="aa182d4f0c0cbaa0a01f13a88b8456c0e51ec3bb5add8786fef469794695687f" exitCode=0 May 21 11:51:13.666053 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:13.665901 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" event={"ID":"938e79e8-41d8-4ee5-b76b-57db2ecc2b00","Type":"ContainerDied","Data":"aa182d4f0c0cbaa0a01f13a88b8456c0e51ec3bb5add8786fef469794695687f"} May 21 11:51:13.666053 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:13.665936 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" event={"ID":"938e79e8-41d8-4ee5-b76b-57db2ecc2b00","Type":"ContainerStarted","Data":"d43275892de127f3166b564502ec729643161845f56087eb4236e504aa244e47"} May 21 11:51:14.670617 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:14.670581 2565 generic.go:358] "Generic (PLEG): container finished" podID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerID="325041c523faf88857ff19380c6c81f837ee3ddd0fb0bf3b7a868915a94b00d8" exitCode=0 May 21 11:51:14.671002 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:14.670619 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" event={"ID":"938e79e8-41d8-4ee5-b76b-57db2ecc2b00","Type":"ContainerDied","Data":"325041c523faf88857ff19380c6c81f837ee3ddd0fb0bf3b7a868915a94b00d8"} May 21 11:51:15.676233 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:15.676195 2565 generic.go:358] "Generic (PLEG): container finished" podID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerID="c06aba16c61326fbe40c7ef80143577e42f87226e9175301e0ba9f7a65916f8c" exitCode=0 May 21 11:51:15.676651 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:15.676254 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" event={"ID":"938e79e8-41d8-4ee5-b76b-57db2ecc2b00","Type":"ContainerDied","Data":"c06aba16c61326fbe40c7ef80143577e42f87226e9175301e0ba9f7a65916f8c"} May 21 11:51:16.823140 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:16.823108 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:16.913378 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:16.913333 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-bundle\") pod \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " May 21 11:51:16.913378 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:16.913387 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csb6l\" (UniqueName: \"kubernetes.io/projected/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-kube-api-access-csb6l\") pod \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " May 21 11:51:16.913638 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:16.913417 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-util\") pod \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\" (UID: \"938e79e8-41d8-4ee5-b76b-57db2ecc2b00\") " May 21 11:51:16.914220 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:16.914135 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-bundle" (OuterVolumeSpecName: "bundle") pod "938e79e8-41d8-4ee5-b76b-57db2ecc2b00" (UID: "938e79e8-41d8-4ee5-b76b-57db2ecc2b00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:51:16.915713 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:16.915681 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-kube-api-access-csb6l" (OuterVolumeSpecName: "kube-api-access-csb6l") pod "938e79e8-41d8-4ee5-b76b-57db2ecc2b00" (UID: "938e79e8-41d8-4ee5-b76b-57db2ecc2b00"). InnerVolumeSpecName "kube-api-access-csb6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:51:16.919211 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:16.919173 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-util" (OuterVolumeSpecName: "util") pod "938e79e8-41d8-4ee5-b76b-57db2ecc2b00" (UID: "938e79e8-41d8-4ee5-b76b-57db2ecc2b00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:51:17.014100 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:17.014013 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:17.014100 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:17.014043 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csb6l\" (UniqueName: \"kubernetes.io/projected/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-kube-api-access-csb6l\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:17.014100 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:17.014053 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/938e79e8-41d8-4ee5-b76b-57db2ecc2b00-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:17.687374 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:17.687333 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" event={"ID":"938e79e8-41d8-4ee5-b76b-57db2ecc2b00","Type":"ContainerDied","Data":"d43275892de127f3166b564502ec729643161845f56087eb4236e504aa244e47"} May 21 11:51:17.687543 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:17.687390 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d43275892de127f3166b564502ec729643161845f56087eb4236e504aa244e47" May 21 11:51:17.687543 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:17.687436 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5v6sm7" May 21 11:51:22.834851 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.834813 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww"] May 21 11:51:22.835253 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.835142 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerName="extract" May 21 11:51:22.835253 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.835153 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerName="extract" May 21 11:51:22.835253 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.835162 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerName="pull" May 21 11:51:22.835253 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.835167 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerName="pull" May 21 11:51:22.835253 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.835183 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerName="util" May 21 11:51:22.835253 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.835188 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerName="util" May 21 11:51:22.835253 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.835242 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="938e79e8-41d8-4ee5-b76b-57db2ecc2b00" containerName="extract" May 21 11:51:22.837728 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.837708 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:22.840583 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.840551 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 11:51:22.841570 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.841546 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 11:51:22.841570 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.841563 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-db7kr\"" May 21 11:51:22.848234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.848203 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww"] May 21 11:51:22.965153 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.965108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84wlg\" (UniqueName: \"kubernetes.io/projected/706d278c-e140-4f4c-a973-9149f4e4c3cb-kube-api-access-84wlg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:22.965153 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.965157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:22.965439 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:22.965337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:23.066630 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.066580 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:23.066840 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.066704 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:23.066840 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.066762 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84wlg\" (UniqueName: \"kubernetes.io/projected/706d278c-e140-4f4c-a973-9149f4e4c3cb-kube-api-access-84wlg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:23.067002 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.066977 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:23.067054 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.067011 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:23.077764 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.077733 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84wlg\" (UniqueName: \"kubernetes.io/projected/706d278c-e140-4f4c-a973-9149f4e4c3cb-kube-api-access-84wlg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:23.148815 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.148722 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:23.312209 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.312180 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww"] May 21 11:51:23.313692 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:23.313657 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706d278c_e140_4f4c_a973_9149f4e4c3cb.slice/crio-a501f12d21a0bc6d165099425a2b6722e0fcff30f4bd246290d175cb88285ff7 WatchSource:0}: Error finding container a501f12d21a0bc6d165099425a2b6722e0fcff30f4bd246290d175cb88285ff7: Status 404 returned error can't find the container with id a501f12d21a0bc6d165099425a2b6722e0fcff30f4bd246290d175cb88285ff7 May 21 11:51:23.710537 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.710452 2565 generic.go:358] "Generic (PLEG): container finished" podID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerID="79d8275694934bb1b4e86bfa87c0621d1a52d254298a95b8372db7f2da6d2dd3" exitCode=0 May 21 11:51:23.710537 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.710527 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" event={"ID":"706d278c-e140-4f4c-a973-9149f4e4c3cb","Type":"ContainerDied","Data":"79d8275694934bb1b4e86bfa87c0621d1a52d254298a95b8372db7f2da6d2dd3"} May 21 11:51:23.710729 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:23.710558 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" event={"ID":"706d278c-e140-4f4c-a973-9149f4e4c3cb","Type":"ContainerStarted","Data":"a501f12d21a0bc6d165099425a2b6722e0fcff30f4bd246290d175cb88285ff7"} May 21 11:51:24.715325 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.715209 2565 generic.go:358] "Generic (PLEG): container finished" podID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerID="afb8e84d8ac7cd69a95f1b173d314580c1c1c56e9adab39036c86408a44d63e7" exitCode=0 May 21 11:51:24.715325 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.715256 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" event={"ID":"706d278c-e140-4f4c-a973-9149f4e4c3cb","Type":"ContainerDied","Data":"afb8e84d8ac7cd69a95f1b173d314580c1c1c56e9adab39036c86408a44d63e7"} May 21 11:51:24.901503 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.901468 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65"] May 21 11:51:24.904896 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.904861 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:24.907687 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.907654 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 11:51:24.907801 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.907667 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 11:51:24.907976 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.907960 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 11:51:24.908311 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.908266 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 11:51:24.908456 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.908440 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2hcz8\"" May 21 11:51:24.918140 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.918115 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65"] May 21 11:51:24.989493 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.989406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/378c1eb8-b502-45ea-b5b3-3b4ad72346de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:24.989493 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.989443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rv82\" (UniqueName: \"kubernetes.io/projected/378c1eb8-b502-45ea-b5b3-3b4ad72346de-kube-api-access-8rv82\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:24.989493 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:24.989474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/378c1eb8-b502-45ea-b5b3-3b4ad72346de-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:25.090730 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.090688 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/378c1eb8-b502-45ea-b5b3-3b4ad72346de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:25.090730 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.090732 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rv82\" (UniqueName: \"kubernetes.io/projected/378c1eb8-b502-45ea-b5b3-3b4ad72346de-kube-api-access-8rv82\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:25.090954 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.090778 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/378c1eb8-b502-45ea-b5b3-3b4ad72346de-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:25.093499 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.093464 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/378c1eb8-b502-45ea-b5b3-3b4ad72346de-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:25.093650 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.093501 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/378c1eb8-b502-45ea-b5b3-3b4ad72346de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:25.104055 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.104027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rv82\" (UniqueName: \"kubernetes.io/projected/378c1eb8-b502-45ea-b5b3-3b4ad72346de-kube-api-access-8rv82\") pod \"opendatahub-operator-controller-manager-7d7f899c7c-ltf65\" (UID: \"378c1eb8-b502-45ea-b5b3-3b4ad72346de\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:25.251694 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.251607 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:25.398174 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.398141 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65"] May 21 11:51:25.401297 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:25.401249 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378c1eb8_b502_45ea_b5b3_3b4ad72346de.slice/crio-4a267f0294c1678cd39b97880440fb5929dd468de6eb1ca08b2b58710f548db9 WatchSource:0}: Error finding container 4a267f0294c1678cd39b97880440fb5929dd468de6eb1ca08b2b58710f548db9: Status 404 returned error can't find the container with id 4a267f0294c1678cd39b97880440fb5929dd468de6eb1ca08b2b58710f548db9 May 21 11:51:25.720919 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.720885 2565 generic.go:358] "Generic (PLEG): container finished" podID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerID="fd0de9efaa608f3e4b9429f24f84d27c5aa711d6df9a58d56d11407b38ed1fe6" exitCode=0 May 21 11:51:25.721354 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.720976 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" event={"ID":"706d278c-e140-4f4c-a973-9149f4e4c3cb","Type":"ContainerDied","Data":"fd0de9efaa608f3e4b9429f24f84d27c5aa711d6df9a58d56d11407b38ed1fe6"} May 21 11:51:25.722218 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:25.722196 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" event={"ID":"378c1eb8-b502-45ea-b5b3-3b4ad72346de","Type":"ContainerStarted","Data":"4a267f0294c1678cd39b97880440fb5929dd468de6eb1ca08b2b58710f548db9"} May 21 11:51:27.987397 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:27.987367 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:28.119332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.119263 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-util\") pod \"706d278c-e140-4f4c-a973-9149f4e4c3cb\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " May 21 11:51:28.119518 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.119367 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84wlg\" (UniqueName: \"kubernetes.io/projected/706d278c-e140-4f4c-a973-9149f4e4c3cb-kube-api-access-84wlg\") pod \"706d278c-e140-4f4c-a973-9149f4e4c3cb\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " May 21 11:51:28.119518 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.119421 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-bundle\") pod \"706d278c-e140-4f4c-a973-9149f4e4c3cb\" (UID: \"706d278c-e140-4f4c-a973-9149f4e4c3cb\") " May 21 11:51:28.120284 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.120211 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-bundle" (OuterVolumeSpecName: "bundle") pod "706d278c-e140-4f4c-a973-9149f4e4c3cb" (UID: "706d278c-e140-4f4c-a973-9149f4e4c3cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:51:28.121887 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.121857 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706d278c-e140-4f4c-a973-9149f4e4c3cb-kube-api-access-84wlg" (OuterVolumeSpecName: "kube-api-access-84wlg") pod "706d278c-e140-4f4c-a973-9149f4e4c3cb" (UID: "706d278c-e140-4f4c-a973-9149f4e4c3cb"). InnerVolumeSpecName "kube-api-access-84wlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:51:28.125346 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.125321 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-util" (OuterVolumeSpecName: "util") pod "706d278c-e140-4f4c-a973-9149f4e4c3cb" (UID: "706d278c-e140-4f4c-a973-9149f4e4c3cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:51:28.221090 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.220990 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:28.221090 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.221027 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84wlg\" (UniqueName: \"kubernetes.io/projected/706d278c-e140-4f4c-a973-9149f4e4c3cb-kube-api-access-84wlg\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:28.221090 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.221038 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706d278c-e140-4f4c-a973-9149f4e4c3cb-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:28.735724 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.735691 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" May 21 11:51:28.735724 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.735705 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97r6ww" event={"ID":"706d278c-e140-4f4c-a973-9149f4e4c3cb","Type":"ContainerDied","Data":"a501f12d21a0bc6d165099425a2b6722e0fcff30f4bd246290d175cb88285ff7"} May 21 11:51:28.735967 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.735745 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a501f12d21a0bc6d165099425a2b6722e0fcff30f4bd246290d175cb88285ff7" May 21 11:51:28.737244 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.737218 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" event={"ID":"378c1eb8-b502-45ea-b5b3-3b4ad72346de","Type":"ContainerStarted","Data":"97c07a03bdc7fc5174833481dc8239a755db2b16abec84edf9dd0e272a3bb5bf"} May 21 11:51:28.737460 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.737435 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:28.763544 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:28.763493 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" podStartSLOduration=2.151983901 podStartE2EDuration="4.763478003s" podCreationTimestamp="2026-05-21 11:51:24 +0000 UTC" firstStartedPulling="2026-05-21 11:51:25.402993733 +0000 UTC m=+458.831924578" lastFinishedPulling="2026-05-21 11:51:28.014487833 +0000 UTC m=+461.443418680" observedRunningTime="2026-05-21 11:51:28.762837203 +0000 UTC m=+462.191768071" watchObservedRunningTime="2026-05-21 11:51:28.763478003 +0000 UTC m=+462.192408870" May 21 11:51:39.743187 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:39.743144 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7f899c7c-ltf65" May 21 11:51:42.106621 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.106586 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2"] May 21 11:51:42.107027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.106908 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerName="pull" May 21 11:51:42.107027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.106919 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerName="pull" May 21 11:51:42.107027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.106934 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerName="util" May 21 11:51:42.107027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.106939 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerName="util" May 21 11:51:42.107027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.106956 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerName="extract" May 21 11:51:42.107027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.106962 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerName="extract" May 21 11:51:42.107027 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.107016 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="706d278c-e140-4f4c-a973-9149f4e4c3cb" containerName="extract" May 21 11:51:42.111218 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.111202 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.114353 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.114324 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-db7kr\"" May 21 11:51:42.114792 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.114768 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 11:51:42.115441 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.115424 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 11:51:42.124601 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.124574 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2"] May 21 11:51:42.251583 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.251535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5tt5\" (UniqueName: \"kubernetes.io/projected/0f44e84e-5072-4321-80c1-cc917d9db9fd-kube-api-access-b5tt5\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.251772 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.251612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.251772 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.251704 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.352343 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.352297 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5tt5\" (UniqueName: \"kubernetes.io/projected/0f44e84e-5072-4321-80c1-cc917d9db9fd-kube-api-access-b5tt5\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.352478 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.352366 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.352478 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.352410 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.352757 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.352734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.352816 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.352758 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.373210 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.373142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5tt5\" (UniqueName: \"kubernetes.io/projected/0f44e84e-5072-4321-80c1-cc917d9db9fd-kube-api-access-b5tt5\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.420897 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.420858 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:42.565024 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.564990 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2"] May 21 11:51:42.568208 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:42.568185 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f44e84e_5072_4321_80c1_cc917d9db9fd.slice/crio-d0f6206287b4c13727c8feb63b732eb0605308c3aa6c2a9461d130f5ec837c27 WatchSource:0}: Error finding container d0f6206287b4c13727c8feb63b732eb0605308c3aa6c2a9461d130f5ec837c27: Status 404 returned error can't find the container with id d0f6206287b4c13727c8feb63b732eb0605308c3aa6c2a9461d130f5ec837c27 May 21 11:51:42.785205 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.785165 2565 generic.go:358] "Generic (PLEG): container finished" podID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerID="4e0e6db2aabc45bdb6e7778091bc1fce22ee249b1d71bcd7cdf2a3378b71e73b" exitCode=0 May 21 11:51:42.785400 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.785253 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" event={"ID":"0f44e84e-5072-4321-80c1-cc917d9db9fd","Type":"ContainerDied","Data":"4e0e6db2aabc45bdb6e7778091bc1fce22ee249b1d71bcd7cdf2a3378b71e73b"} May 21 11:51:42.785400 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:42.785303 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" event={"ID":"0f44e84e-5072-4321-80c1-cc917d9db9fd","Type":"ContainerStarted","Data":"d0f6206287b4c13727c8feb63b732eb0605308c3aa6c2a9461d130f5ec837c27"} May 21 11:51:43.389866 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.389832 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7"] May 21 11:51:43.393985 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.393961 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.396781 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.396754 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 11:51:43.396952 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.396934 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 11:51:43.398157 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.398138 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t5slm\"" May 21 11:51:43.408160 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.408134 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7"] May 21 11:51:43.564634 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.564599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f4b44d4-3bcd-4042-940e-7980e80fb285-tls-certs\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.564634 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.564640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v76wc\" (UniqueName: \"kubernetes.io/projected/6f4b44d4-3bcd-4042-940e-7980e80fb285-kube-api-access-v76wc\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.564853 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.564713 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f4b44d4-3bcd-4042-940e-7980e80fb285-tmp\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.666168 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.666076 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f4b44d4-3bcd-4042-940e-7980e80fb285-tmp\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.666352 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.666178 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f4b44d4-3bcd-4042-940e-7980e80fb285-tls-certs\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.666352 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.666211 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v76wc\" (UniqueName: \"kubernetes.io/projected/6f4b44d4-3bcd-4042-940e-7980e80fb285-kube-api-access-v76wc\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.668806 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.668779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f4b44d4-3bcd-4042-940e-7980e80fb285-tmp\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.669165 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.669140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f4b44d4-3bcd-4042-940e-7980e80fb285-tls-certs\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.675811 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.675788 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v76wc\" (UniqueName: \"kubernetes.io/projected/6f4b44d4-3bcd-4042-940e-7980e80fb285-kube-api-access-v76wc\") pod \"kube-auth-proxy-ff9d596fb-fvhw7\" (UID: \"6f4b44d4-3bcd-4042-940e-7980e80fb285\") " pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.703883 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.703843 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" May 21 11:51:43.870876 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:43.870849 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7"] May 21 11:51:43.873146 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:43.873110 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4b44d4_3bcd_4042_940e_7980e80fb285.slice/crio-496dd129dd98012772594489a733af7026815536290fe2a267cfc7d6f22018db WatchSource:0}: Error finding container 496dd129dd98012772594489a733af7026815536290fe2a267cfc7d6f22018db: Status 404 returned error can't find the container with id 496dd129dd98012772594489a733af7026815536290fe2a267cfc7d6f22018db May 21 11:51:44.796688 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:44.796647 2565 generic.go:358] "Generic (PLEG): container finished" podID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerID="3ae824694497bd92ae135723c4a472c59888edb9b79a4b0141d800e3ac406d8e" exitCode=0 May 21 11:51:44.797159 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:44.796722 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" event={"ID":"0f44e84e-5072-4321-80c1-cc917d9db9fd","Type":"ContainerDied","Data":"3ae824694497bd92ae135723c4a472c59888edb9b79a4b0141d800e3ac406d8e"} May 21 11:51:44.798144 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:44.798113 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" event={"ID":"6f4b44d4-3bcd-4042-940e-7980e80fb285","Type":"ContainerStarted","Data":"496dd129dd98012772594489a733af7026815536290fe2a267cfc7d6f22018db"} May 21 11:51:45.804433 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:45.804390 2565 generic.go:358] "Generic (PLEG): container finished" podID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerID="35e6fd8c25b0eafcd791d203f50cfba5f995fe1fa33b843509fd6cb21365f7dc" exitCode=0 May 21 11:51:45.804780 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:45.804462 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" event={"ID":"0f44e84e-5072-4321-80c1-cc917d9db9fd","Type":"ContainerDied","Data":"35e6fd8c25b0eafcd791d203f50cfba5f995fe1fa33b843509fd6cb21365f7dc"} May 21 11:51:45.946509 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:45.946474 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-qsdxh"] May 21 11:51:45.949819 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:45.949801 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:45.952524 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:45.952500 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-97lzd\"" May 21 11:51:45.952524 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:45.952512 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 11:51:45.958167 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:45.958144 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-qsdxh"] May 21 11:51:46.093110 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.093067 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87f3dc02-dcf0-470e-a2e5-40f261d0af81-cert\") pod \"odh-model-controller-858dbf95b8-qsdxh\" (UID: \"87f3dc02-dcf0-470e-a2e5-40f261d0af81\") " pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:46.093302 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.093120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4khb9\" (UniqueName: \"kubernetes.io/projected/87f3dc02-dcf0-470e-a2e5-40f261d0af81-kube-api-access-4khb9\") pod \"odh-model-controller-858dbf95b8-qsdxh\" (UID: \"87f3dc02-dcf0-470e-a2e5-40f261d0af81\") " pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:46.194456 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.194418 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87f3dc02-dcf0-470e-a2e5-40f261d0af81-cert\") pod \"odh-model-controller-858dbf95b8-qsdxh\" (UID: \"87f3dc02-dcf0-470e-a2e5-40f261d0af81\") " pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:46.194640 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.194465 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4khb9\" (UniqueName: \"kubernetes.io/projected/87f3dc02-dcf0-470e-a2e5-40f261d0af81-kube-api-access-4khb9\") pod \"odh-model-controller-858dbf95b8-qsdxh\" (UID: \"87f3dc02-dcf0-470e-a2e5-40f261d0af81\") " pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:46.194640 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:51:46.194595 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 11:51:46.194731 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:51:46.194672 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87f3dc02-dcf0-470e-a2e5-40f261d0af81-cert podName:87f3dc02-dcf0-470e-a2e5-40f261d0af81 nodeName:}" failed. No retries permitted until 2026-05-21 11:51:46.694647154 +0000 UTC m=+480.123578011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87f3dc02-dcf0-470e-a2e5-40f261d0af81-cert") pod "odh-model-controller-858dbf95b8-qsdxh" (UID: "87f3dc02-dcf0-470e-a2e5-40f261d0af81") : secret "odh-model-controller-webhook-cert" not found May 21 11:51:46.203876 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.203831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4khb9\" (UniqueName: \"kubernetes.io/projected/87f3dc02-dcf0-470e-a2e5-40f261d0af81-kube-api-access-4khb9\") pod \"odh-model-controller-858dbf95b8-qsdxh\" (UID: \"87f3dc02-dcf0-470e-a2e5-40f261d0af81\") " pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:46.701028 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.700983 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87f3dc02-dcf0-470e-a2e5-40f261d0af81-cert\") pod \"odh-model-controller-858dbf95b8-qsdxh\" (UID: \"87f3dc02-dcf0-470e-a2e5-40f261d0af81\") " pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:46.704001 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.703975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87f3dc02-dcf0-470e-a2e5-40f261d0af81-cert\") pod \"odh-model-controller-858dbf95b8-qsdxh\" (UID: \"87f3dc02-dcf0-470e-a2e5-40f261d0af81\") " pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:46.861189 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.861152 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:46.955691 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:46.955482 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:47.032201 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.032173 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-qsdxh"] May 21 11:51:47.039552 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:47.039523 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f3dc02_dcf0_470e_a2e5_40f261d0af81.slice/crio-5089c1d6c0123ad60a6ae3c359961a6cfd4a7f252f85e8a6b0e98b01479c9afa WatchSource:0}: Error finding container 5089c1d6c0123ad60a6ae3c359961a6cfd4a7f252f85e8a6b0e98b01479c9afa: Status 404 returned error can't find the container with id 5089c1d6c0123ad60a6ae3c359961a6cfd4a7f252f85e8a6b0e98b01479c9afa May 21 11:51:47.105473 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.105435 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-util\") pod \"0f44e84e-5072-4321-80c1-cc917d9db9fd\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " May 21 11:51:47.105651 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.105565 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5tt5\" (UniqueName: \"kubernetes.io/projected/0f44e84e-5072-4321-80c1-cc917d9db9fd-kube-api-access-b5tt5\") pod \"0f44e84e-5072-4321-80c1-cc917d9db9fd\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " May 21 11:51:47.105651 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.105593 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-bundle\") pod \"0f44e84e-5072-4321-80c1-cc917d9db9fd\" (UID: \"0f44e84e-5072-4321-80c1-cc917d9db9fd\") " May 21 11:51:47.106529 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.106496 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-bundle" (OuterVolumeSpecName: "bundle") pod "0f44e84e-5072-4321-80c1-cc917d9db9fd" (UID: "0f44e84e-5072-4321-80c1-cc917d9db9fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:51:47.107822 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.107796 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f44e84e-5072-4321-80c1-cc917d9db9fd-kube-api-access-b5tt5" (OuterVolumeSpecName: "kube-api-access-b5tt5") pod "0f44e84e-5072-4321-80c1-cc917d9db9fd" (UID: "0f44e84e-5072-4321-80c1-cc917d9db9fd"). InnerVolumeSpecName "kube-api-access-b5tt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:51:47.112444 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.112414 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-util" (OuterVolumeSpecName: "util") pod "0f44e84e-5072-4321-80c1-cc917d9db9fd" (UID: "0f44e84e-5072-4321-80c1-cc917d9db9fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:51:47.207024 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.206928 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5tt5\" (UniqueName: \"kubernetes.io/projected/0f44e84e-5072-4321-80c1-cc917d9db9fd-kube-api-access-b5tt5\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:47.207024 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.206963 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:47.207024 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.206977 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f44e84e-5072-4321-80c1-cc917d9db9fd-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:51:47.814546 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.814498 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" event={"ID":"87f3dc02-dcf0-470e-a2e5-40f261d0af81","Type":"ContainerStarted","Data":"5089c1d6c0123ad60a6ae3c359961a6cfd4a7f252f85e8a6b0e98b01479c9afa"} May 21 11:51:47.816497 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.816469 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" event={"ID":"0f44e84e-5072-4321-80c1-cc917d9db9fd","Type":"ContainerDied","Data":"d0f6206287b4c13727c8feb63b732eb0605308c3aa6c2a9461d130f5ec837c27"} May 21 11:51:47.816624 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.816501 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0f6206287b4c13727c8feb63b732eb0605308c3aa6c2a9461d130f5ec837c27" May 21 11:51:47.816624 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.816558 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rq7k2" May 21 11:51:47.818658 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.818633 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" event={"ID":"6f4b44d4-3bcd-4042-940e-7980e80fb285","Type":"ContainerStarted","Data":"93b491dea14eced30f681f6f20701ef99858b7691e47d6dc239e40a8dd377963"} May 21 11:51:47.845238 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:47.845172 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ff9d596fb-fvhw7" podStartSLOduration=1.8929497830000002 podStartE2EDuration="4.845155526s" podCreationTimestamp="2026-05-21 11:51:43 +0000 UTC" firstStartedPulling="2026-05-21 11:51:43.87499208 +0000 UTC m=+477.303922926" lastFinishedPulling="2026-05-21 11:51:46.827197824 +0000 UTC m=+480.256128669" observedRunningTime="2026-05-21 11:51:47.841783801 +0000 UTC m=+481.270714671" watchObservedRunningTime="2026-05-21 11:51:47.845155526 +0000 UTC m=+481.274086417" May 21 11:51:49.831164 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:49.831131 2565 generic.go:358] "Generic (PLEG): container finished" podID="87f3dc02-dcf0-470e-a2e5-40f261d0af81" containerID="adb4461f35cb8f5c2d4c445e3e49e36cbeeacf0b66f12ffc9a76c9cdd20efa74" exitCode=1 May 21 11:51:49.831591 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:49.831209 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" event={"ID":"87f3dc02-dcf0-470e-a2e5-40f261d0af81","Type":"ContainerDied","Data":"adb4461f35cb8f5c2d4c445e3e49e36cbeeacf0b66f12ffc9a76c9cdd20efa74"} May 21 11:51:49.831591 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:49.831434 2565 scope.go:117] "RemoveContainer" containerID="adb4461f35cb8f5c2d4c445e3e49e36cbeeacf0b66f12ffc9a76c9cdd20efa74" May 21 11:51:50.836791 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:50.836749 2565 generic.go:358] "Generic (PLEG): container finished" podID="87f3dc02-dcf0-470e-a2e5-40f261d0af81" containerID="774f8ab7347d0d246f2cc134beb3095756dd31772d91ac79c5f97f6745cbe564" exitCode=1 May 21 11:51:50.837317 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:50.836804 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" event={"ID":"87f3dc02-dcf0-470e-a2e5-40f261d0af81","Type":"ContainerDied","Data":"774f8ab7347d0d246f2cc134beb3095756dd31772d91ac79c5f97f6745cbe564"} May 21 11:51:50.837317 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:50.836837 2565 scope.go:117] "RemoveContainer" containerID="adb4461f35cb8f5c2d4c445e3e49e36cbeeacf0b66f12ffc9a76c9cdd20efa74" May 21 11:51:50.837317 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:50.837114 2565 scope.go:117] "RemoveContainer" containerID="774f8ab7347d0d246f2cc134beb3095756dd31772d91ac79c5f97f6745cbe564" May 21 11:51:50.837503 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:51:50.837395 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-qsdxh_opendatahub(87f3dc02-dcf0-470e-a2e5-40f261d0af81)\"" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" podUID="87f3dc02-dcf0-470e-a2e5-40f261d0af81" May 21 11:51:51.760796 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.760766 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5xt7d"] May 21 11:51:51.761180 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.761161 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerName="util" May 21 11:51:51.761259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.761182 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerName="util" May 21 11:51:51.761259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.761205 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerName="pull" May 21 11:51:51.761259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.761213 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerName="pull" May 21 11:51:51.761259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.761230 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerName="extract" May 21 11:51:51.761259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.761239 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerName="extract" May 21 11:51:51.761528 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.761352 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f44e84e-5072-4321-80c1-cc917d9db9fd" containerName="extract" May 21 11:51:51.765571 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.765549 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:51.768821 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.768795 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vxqrw\"" May 21 11:51:51.769221 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.769207 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 11:51:51.777314 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.777290 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5xt7d"] May 21 11:51:51.842075 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.842048 2565 scope.go:117] "RemoveContainer" containerID="774f8ab7347d0d246f2cc134beb3095756dd31772d91ac79c5f97f6745cbe564" May 21 11:51:51.842454 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:51:51.842258 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-qsdxh_opendatahub(87f3dc02-dcf0-470e-a2e5-40f261d0af81)\"" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" podUID="87f3dc02-dcf0-470e-a2e5-40f261d0af81" May 21 11:51:51.853262 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.853237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfh9\" (UniqueName: \"kubernetes.io/projected/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-kube-api-access-crfh9\") pod \"kserve-controller-manager-856948b99f-5xt7d\" (UID: \"abd193d7-1f7c-45e8-a5fa-7b624f473a0c\") " pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:51.853332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.853312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-cert\") pod \"kserve-controller-manager-856948b99f-5xt7d\" (UID: \"abd193d7-1f7c-45e8-a5fa-7b624f473a0c\") " pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:51.954321 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.954247 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crfh9\" (UniqueName: \"kubernetes.io/projected/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-kube-api-access-crfh9\") pod \"kserve-controller-manager-856948b99f-5xt7d\" (UID: \"abd193d7-1f7c-45e8-a5fa-7b624f473a0c\") " pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:51.954536 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.954332 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-cert\") pod \"kserve-controller-manager-856948b99f-5xt7d\" (UID: \"abd193d7-1f7c-45e8-a5fa-7b624f473a0c\") " pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:51.954536 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:51:51.954410 2565 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 11:51:51.954536 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:51:51.954477 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-cert podName:abd193d7-1f7c-45e8-a5fa-7b624f473a0c nodeName:}" failed. No retries permitted until 2026-05-21 11:51:52.454458909 +0000 UTC m=+485.883389753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-cert") pod "kserve-controller-manager-856948b99f-5xt7d" (UID: "abd193d7-1f7c-45e8-a5fa-7b624f473a0c") : secret "kserve-webhook-server-cert" not found May 21 11:51:51.970298 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:51.970254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfh9\" (UniqueName: \"kubernetes.io/projected/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-kube-api-access-crfh9\") pod \"kserve-controller-manager-856948b99f-5xt7d\" (UID: \"abd193d7-1f7c-45e8-a5fa-7b624f473a0c\") " pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:52.459959 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:52.459923 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-cert\") pod \"kserve-controller-manager-856948b99f-5xt7d\" (UID: \"abd193d7-1f7c-45e8-a5fa-7b624f473a0c\") " pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:52.462482 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:52.462461 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd193d7-1f7c-45e8-a5fa-7b624f473a0c-cert\") pod \"kserve-controller-manager-856948b99f-5xt7d\" (UID: \"abd193d7-1f7c-45e8-a5fa-7b624f473a0c\") " pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:52.677646 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:52.677601 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:52.840510 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:52.840474 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd193d7_1f7c_45e8_a5fa_7b624f473a0c.slice/crio-d50f1b083b095b479239611707931a0797c4714b22d8f33ff4fc0dafd31bf87b WatchSource:0}: Error finding container d50f1b083b095b479239611707931a0797c4714b22d8f33ff4fc0dafd31bf87b: Status 404 returned error can't find the container with id d50f1b083b095b479239611707931a0797c4714b22d8f33ff4fc0dafd31bf87b May 21 11:51:52.846340 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:52.846308 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" event={"ID":"abd193d7-1f7c-45e8-a5fa-7b624f473a0c","Type":"ContainerStarted","Data":"d50f1b083b095b479239611707931a0797c4714b22d8f33ff4fc0dafd31bf87b"} May 21 11:51:52.849815 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:52.849791 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5xt7d"] May 21 11:51:56.804583 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.804496 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b"] May 21 11:51:56.808596 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.808570 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:56.828390 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.828358 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 11:51:56.828390 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.828386 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 11:51:56.828652 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.828528 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-db7kr\"" May 21 11:51:56.861335 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.861305 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:51:56.861546 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.861437 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" event={"ID":"abd193d7-1f7c-45e8-a5fa-7b624f473a0c","Type":"ContainerStarted","Data":"006d663f23c928c5efc1245305b45637ee382f8a6a9b92c6573202c83afd2e91"} May 21 11:51:56.861720 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.861708 2565 scope.go:117] "RemoveContainer" containerID="774f8ab7347d0d246f2cc134beb3095756dd31772d91ac79c5f97f6745cbe564" May 21 11:51:56.861895 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:51:56.861881 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-qsdxh_opendatahub(87f3dc02-dcf0-470e-a2e5-40f261d0af81)\"" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" podUID="87f3dc02-dcf0-470e-a2e5-40f261d0af81" May 21 11:51:56.883002 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.882971 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b"] May 21 11:51:56.901165 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.901128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:56.901362 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.901253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-982qf\" (UniqueName: \"kubernetes.io/projected/6ec990af-f513-45e6-acd0-991048c650a8-kube-api-access-982qf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:56.901362 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.901343 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:56.975421 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:56.975352 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" podStartSLOduration=2.452910936 podStartE2EDuration="5.975334414s" podCreationTimestamp="2026-05-21 11:51:51 +0000 UTC" firstStartedPulling="2026-05-21 11:51:52.841873032 +0000 UTC m=+486.270803877" lastFinishedPulling="2026-05-21 11:51:56.364296502 +0000 UTC m=+489.793227355" observedRunningTime="2026-05-21 11:51:56.964678486 +0000 UTC m=+490.393609355" watchObservedRunningTime="2026-05-21 11:51:56.975334414 +0000 UTC m=+490.404265280" May 21 11:51:57.002264 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.002228 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:57.002459 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.002300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:57.002459 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.002373 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-982qf\" (UniqueName: \"kubernetes.io/projected/6ec990af-f513-45e6-acd0-991048c650a8-kube-api-access-982qf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:57.002722 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.002702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:57.002791 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.002715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:57.026236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.026198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-982qf\" (UniqueName: \"kubernetes.io/projected/6ec990af-f513-45e6-acd0-991048c650a8-kube-api-access-982qf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:57.118205 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.118162 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:51:57.284101 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.284063 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b"] May 21 11:51:57.288796 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:57.288769 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec990af_f513_45e6_acd0_991048c650a8.slice/crio-25e4cbbf09803a4a245d188ad52fdb90a85131d0f34a35e7dacf01ef8a756ff2 WatchSource:0}: Error finding container 25e4cbbf09803a4a245d188ad52fdb90a85131d0f34a35e7dacf01ef8a756ff2: Status 404 returned error can't find the container with id 25e4cbbf09803a4a245d188ad52fdb90a85131d0f34a35e7dacf01ef8a756ff2 May 21 11:51:57.866325 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.866257 2565 generic.go:358] "Generic (PLEG): container finished" podID="6ec990af-f513-45e6-acd0-991048c650a8" containerID="db84f453153176543e5609b65c2de56a59490ab2d212c7ac7497665d6386f60d" exitCode=0 May 21 11:51:57.866708 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.866351 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" event={"ID":"6ec990af-f513-45e6-acd0-991048c650a8","Type":"ContainerDied","Data":"db84f453153176543e5609b65c2de56a59490ab2d212c7ac7497665d6386f60d"} May 21 11:51:57.866708 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.866384 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" event={"ID":"6ec990af-f513-45e6-acd0-991048c650a8","Type":"ContainerStarted","Data":"25e4cbbf09803a4a245d188ad52fdb90a85131d0f34a35e7dacf01ef8a756ff2"} May 21 11:51:57.866708 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:57.866687 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:51:58.929500 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:58.929456 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt"] May 21 11:51:58.933187 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:58.933161 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:51:58.938531 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:58.938497 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 11:51:58.938687 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:58.938545 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-84cm4\"" May 21 11:51:58.938687 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:58.938609 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 11:51:58.948214 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:58.948187 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt"] May 21 11:51:59.023012 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.022966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b613581f-82a0-498b-be06-b123cb935619-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xkrdt\" (UID: \"b613581f-82a0-498b-be06-b123cb935619\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:51:59.023167 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.023083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8plgp\" (UniqueName: \"kubernetes.io/projected/b613581f-82a0-498b-be06-b123cb935619-kube-api-access-8plgp\") pod \"servicemesh-operator3-55f49c5f94-xkrdt\" (UID: \"b613581f-82a0-498b-be06-b123cb935619\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:51:59.123814 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.123786 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b613581f-82a0-498b-be06-b123cb935619-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xkrdt\" (UID: \"b613581f-82a0-498b-be06-b123cb935619\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:51:59.123920 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.123848 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8plgp\" (UniqueName: \"kubernetes.io/projected/b613581f-82a0-498b-be06-b123cb935619-kube-api-access-8plgp\") pod \"servicemesh-operator3-55f49c5f94-xkrdt\" (UID: \"b613581f-82a0-498b-be06-b123cb935619\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:51:59.126401 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.126381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b613581f-82a0-498b-be06-b123cb935619-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xkrdt\" (UID: \"b613581f-82a0-498b-be06-b123cb935619\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:51:59.137061 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.137027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8plgp\" (UniqueName: \"kubernetes.io/projected/b613581f-82a0-498b-be06-b123cb935619-kube-api-access-8plgp\") pod \"servicemesh-operator3-55f49c5f94-xkrdt\" (UID: \"b613581f-82a0-498b-be06-b123cb935619\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:51:59.245333 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.245224 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:51:59.414151 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.414114 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt"] May 21 11:51:59.415127 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:51:59.415092 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb613581f_82a0_498b_be06_b123cb935619.slice/crio-ee194f437e66cee99df175500a7c9dba24000a8795feec67c79e17db458e4e91 WatchSource:0}: Error finding container ee194f437e66cee99df175500a7c9dba24000a8795feec67c79e17db458e4e91: Status 404 returned error can't find the container with id ee194f437e66cee99df175500a7c9dba24000a8795feec67c79e17db458e4e91 May 21 11:51:59.875579 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.875549 2565 generic.go:358] "Generic (PLEG): container finished" podID="6ec990af-f513-45e6-acd0-991048c650a8" containerID="9093e51383b4125b9e624b4c30845f3e258a16be33ee3d76b430b6c0c364eec8" exitCode=0 May 21 11:51:59.875792 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.875632 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" event={"ID":"6ec990af-f513-45e6-acd0-991048c650a8","Type":"ContainerDied","Data":"9093e51383b4125b9e624b4c30845f3e258a16be33ee3d76b430b6c0c364eec8"} May 21 11:51:59.877004 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:51:59.876975 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" event={"ID":"b613581f-82a0-498b-be06-b123cb935619","Type":"ContainerStarted","Data":"ee194f437e66cee99df175500a7c9dba24000a8795feec67c79e17db458e4e91"} May 21 11:52:00.884305 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:00.884241 2565 generic.go:358] "Generic (PLEG): container finished" podID="6ec990af-f513-45e6-acd0-991048c650a8" containerID="7a8a778f96bec07bf7725d8d0a265031c55bfa4df1003a1596db27cbbdb40ab2" exitCode=0 May 21 11:52:00.884734 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:00.884314 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" event={"ID":"6ec990af-f513-45e6-acd0-991048c650a8","Type":"ContainerDied","Data":"7a8a778f96bec07bf7725d8d0a265031c55bfa4df1003a1596db27cbbdb40ab2"} May 21 11:52:02.033356 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.033330 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:52:02.154464 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.154327 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-bundle\") pod \"6ec990af-f513-45e6-acd0-991048c650a8\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " May 21 11:52:02.154464 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.154372 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-982qf\" (UniqueName: \"kubernetes.io/projected/6ec990af-f513-45e6-acd0-991048c650a8-kube-api-access-982qf\") pod \"6ec990af-f513-45e6-acd0-991048c650a8\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " May 21 11:52:02.154790 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.154490 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-util\") pod \"6ec990af-f513-45e6-acd0-991048c650a8\" (UID: \"6ec990af-f513-45e6-acd0-991048c650a8\") " May 21 11:52:02.155500 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.155470 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-bundle" (OuterVolumeSpecName: "bundle") pod "6ec990af-f513-45e6-acd0-991048c650a8" (UID: "6ec990af-f513-45e6-acd0-991048c650a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:52:02.157150 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.157121 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec990af-f513-45e6-acd0-991048c650a8-kube-api-access-982qf" (OuterVolumeSpecName: "kube-api-access-982qf") pod "6ec990af-f513-45e6-acd0-991048c650a8" (UID: "6ec990af-f513-45e6-acd0-991048c650a8"). InnerVolumeSpecName "kube-api-access-982qf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:52:02.160547 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.160519 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-util" (OuterVolumeSpecName: "util") pod "6ec990af-f513-45e6-acd0-991048c650a8" (UID: "6ec990af-f513-45e6-acd0-991048c650a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:52:02.255927 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.255882 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:52:02.255927 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.255926 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec990af-f513-45e6-acd0-991048c650a8-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:52:02.256184 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.255942 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-982qf\" (UniqueName: \"kubernetes.io/projected/6ec990af-f513-45e6-acd0-991048c650a8-kube-api-access-982qf\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:52:02.893384 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.893354 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" May 21 11:52:02.893577 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.893343 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acxn4b" event={"ID":"6ec990af-f513-45e6-acd0-991048c650a8","Type":"ContainerDied","Data":"25e4cbbf09803a4a245d188ad52fdb90a85131d0f34a35e7dacf01ef8a756ff2"} May 21 11:52:02.893577 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.893465 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25e4cbbf09803a4a245d188ad52fdb90a85131d0f34a35e7dacf01ef8a756ff2" May 21 11:52:02.895008 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.894978 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" event={"ID":"b613581f-82a0-498b-be06-b123cb935619","Type":"ContainerStarted","Data":"7d94d9ba2774bb0dfdf5532d2aaaca774abe98410b7d67e20e754e7e1a3b00c1"} May 21 11:52:02.895144 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.895132 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:52:02.922117 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:02.922052 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" podStartSLOduration=2.389881573 podStartE2EDuration="4.922037728s" podCreationTimestamp="2026-05-21 11:51:58 +0000 UTC" firstStartedPulling="2026-05-21 11:51:59.417706165 +0000 UTC m=+492.846637010" lastFinishedPulling="2026-05-21 11:52:01.949862319 +0000 UTC m=+495.378793165" observedRunningTime="2026-05-21 11:52:02.919928303 +0000 UTC m=+496.348859169" watchObservedRunningTime="2026-05-21 11:52:02.922037728 +0000 UTC m=+496.350968592" May 21 11:52:06.861756 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:06.861713 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:52:06.862167 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:06.862126 2565 scope.go:117] "RemoveContainer" containerID="774f8ab7347d0d246f2cc134beb3095756dd31772d91ac79c5f97f6745cbe564" May 21 11:52:07.916083 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:07.916043 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" event={"ID":"87f3dc02-dcf0-470e-a2e5-40f261d0af81","Type":"ContainerStarted","Data":"8453af06e35940dab7c7e326d95a7514a5f421bdffe4ced3a44cc6bed6186b7e"} May 21 11:52:07.916609 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:07.916304 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:52:07.945132 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:07.945071 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" podStartSLOduration=2.8582770379999998 podStartE2EDuration="22.945054125s" podCreationTimestamp="2026-05-21 11:51:45 +0000 UTC" firstStartedPulling="2026-05-21 11:51:47.040888434 +0000 UTC m=+480.469819280" lastFinishedPulling="2026-05-21 11:52:07.127665511 +0000 UTC m=+500.556596367" observedRunningTime="2026-05-21 11:52:07.942681817 +0000 UTC m=+501.371612683" watchObservedRunningTime="2026-05-21 11:52:07.945054125 +0000 UTC m=+501.373984991" May 21 11:52:08.266874 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.266798 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2"] May 21 11:52:08.267147 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.267135 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec990af-f513-45e6-acd0-991048c650a8" containerName="pull" May 21 11:52:08.267185 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.267150 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec990af-f513-45e6-acd0-991048c650a8" containerName="pull" May 21 11:52:08.267185 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.267158 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec990af-f513-45e6-acd0-991048c650a8" containerName="extract" May 21 11:52:08.267185 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.267166 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec990af-f513-45e6-acd0-991048c650a8" containerName="extract" May 21 11:52:08.267296 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.267186 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec990af-f513-45e6-acd0-991048c650a8" containerName="util" May 21 11:52:08.267296 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.267191 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec990af-f513-45e6-acd0-991048c650a8" containerName="util" May 21 11:52:08.267296 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.267250 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ec990af-f513-45e6-acd0-991048c650a8" containerName="extract" May 21 11:52:08.270304 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.270283 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.273289 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.273246 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 11:52:08.273743 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.273721 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 11:52:08.273942 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.273728 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7tq9l\"" May 21 11:52:08.275032 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.275011 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 11:52:08.275140 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.275020 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 11:52:08.294330 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.294299 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2"] May 21 11:52:08.413627 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.413589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.413793 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.413637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk56t\" (UniqueName: \"kubernetes.io/projected/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-kube-api-access-nk56t\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.413793 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.413708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.413793 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.413773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.413900 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.413802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.413900 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.413836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.413900 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.413860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.514943 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.514905 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.515094 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.514961 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk56t\" (UniqueName: \"kubernetes.io/projected/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-kube-api-access-nk56t\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.515094 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.514990 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.515094 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.515024 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.515094 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.515044 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.515094 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.515074 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.515343 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.515161 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.515696 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.515661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.518454 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.518375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.518631 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.518477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.518770 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.518745 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.520657 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.520624 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.524550 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.524519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk56t\" (UniqueName: \"kubernetes.io/projected/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-kube-api-access-nk56t\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.524774 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.524753 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1681c9d0-51b2-4f9a-8212-6d7d5bdee228-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vxvf2\" (UID: \"1681c9d0-51b2-4f9a-8212-6d7d5bdee228\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.582046 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.582007 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:08.742137 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.742104 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2"] May 21 11:52:08.744331 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:52:08.744258 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1681c9d0_51b2_4f9a_8212_6d7d5bdee228.slice/crio-6527bcf916c00245790837c0bf87501284e88a2cd494a39370445ab95f9e5571 WatchSource:0}: Error finding container 6527bcf916c00245790837c0bf87501284e88a2cd494a39370445ab95f9e5571: Status 404 returned error can't find the container with id 6527bcf916c00245790837c0bf87501284e88a2cd494a39370445ab95f9e5571 May 21 11:52:08.921348 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:08.921302 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" event={"ID":"1681c9d0-51b2-4f9a-8212-6d7d5bdee228","Type":"ContainerStarted","Data":"6527bcf916c00245790837c0bf87501284e88a2cd494a39370445ab95f9e5571"} May 21 11:52:11.352958 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:11.352917 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 21 11:52:11.353203 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:11.353002 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 21 11:52:11.935585 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:11.935546 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" event={"ID":"1681c9d0-51b2-4f9a-8212-6d7d5bdee228","Type":"ContainerStarted","Data":"2ace6647f7d7ac81d3ebe5ec1423b14b843a3938c18a790256668cd6e6db60fa"} May 21 11:52:11.935759 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:11.935631 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:12.004303 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:12.004226 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" podStartSLOduration=1.397910564 podStartE2EDuration="4.004207494s" podCreationTimestamp="2026-05-21 11:52:08 +0000 UTC" firstStartedPulling="2026-05-21 11:52:08.746386538 +0000 UTC m=+502.175317390" lastFinishedPulling="2026-05-21 11:52:11.352683461 +0000 UTC m=+504.781614320" observedRunningTime="2026-05-21 11:52:11.99029992 +0000 UTC m=+505.419230781" watchObservedRunningTime="2026-05-21 11:52:12.004207494 +0000 UTC m=+505.433138361" May 21 11:52:12.941313 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:12.941266 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vxvf2" May 21 11:52:13.901247 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:13.901209 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xkrdt" May 21 11:52:18.923687 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:18.923652 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-qsdxh" May 21 11:52:28.876142 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:28.876107 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-5xt7d" May 21 11:52:48.274554 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.274466 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d968d8f8f-dmc9w"] May 21 11:52:48.283097 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.283070 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.290994 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.290595 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d968d8f8f-dmc9w"] May 21 11:52:48.371990 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.371962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-console-config\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.371990 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.371998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9c6e915-3882-4064-8890-3de59c030ce9-console-oauth-config\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.372232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.372024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gdk2\" (UniqueName: \"kubernetes.io/projected/c9c6e915-3882-4064-8890-3de59c030ce9-kube-api-access-8gdk2\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.372232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.372095 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-service-ca\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.372232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.372114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-trusted-ca-bundle\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.372232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.372135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-oauth-serving-cert\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.372232 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.372195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9c6e915-3882-4064-8890-3de59c030ce9-console-serving-cert\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.473538 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.473476 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-console-config\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.473538 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.473543 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9c6e915-3882-4064-8890-3de59c030ce9-console-oauth-config\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.473818 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.473570 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gdk2\" (UniqueName: \"kubernetes.io/projected/c9c6e915-3882-4064-8890-3de59c030ce9-kube-api-access-8gdk2\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.473818 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.473609 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-service-ca\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.473818 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.473624 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-trusted-ca-bundle\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.473818 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.473649 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-oauth-serving-cert\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.473818 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.473709 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9c6e915-3882-4064-8890-3de59c030ce9-console-serving-cert\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.474355 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.474330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-console-config\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.474458 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.474395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-service-ca\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.474508 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.474490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-oauth-serving-cert\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.474804 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.474784 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9c6e915-3882-4064-8890-3de59c030ce9-trusted-ca-bundle\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.476371 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.476346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9c6e915-3882-4064-8890-3de59c030ce9-console-serving-cert\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.476371 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.476356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9c6e915-3882-4064-8890-3de59c030ce9-console-oauth-config\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.485006 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.484983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gdk2\" (UniqueName: \"kubernetes.io/projected/c9c6e915-3882-4064-8890-3de59c030ce9-kube-api-access-8gdk2\") pod \"console-d968d8f8f-dmc9w\" (UID: \"c9c6e915-3882-4064-8890-3de59c030ce9\") " pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.594496 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.594462 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:48.732762 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:48.732738 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d968d8f8f-dmc9w"] May 21 11:52:48.734197 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:52:48.734166 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c6e915_3882_4064_8890_3de59c030ce9.slice/crio-e70cf90ffd3a41cfdc53c96d0b2fcdd1862768d62ba819eb59306384cf66dd38 WatchSource:0}: Error finding container e70cf90ffd3a41cfdc53c96d0b2fcdd1862768d62ba819eb59306384cf66dd38: Status 404 returned error can't find the container with id e70cf90ffd3a41cfdc53c96d0b2fcdd1862768d62ba819eb59306384cf66dd38 May 21 11:52:49.078531 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:49.078496 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d968d8f8f-dmc9w" event={"ID":"c9c6e915-3882-4064-8890-3de59c030ce9","Type":"ContainerStarted","Data":"9ebbddafda1950d71529dcddc5ed2826dd33f2da5c6035a61775b5409c10a63f"} May 21 11:52:49.078749 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:49.078537 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d968d8f8f-dmc9w" event={"ID":"c9c6e915-3882-4064-8890-3de59c030ce9","Type":"ContainerStarted","Data":"e70cf90ffd3a41cfdc53c96d0b2fcdd1862768d62ba819eb59306384cf66dd38"} May 21 11:52:49.098246 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:49.098199 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d968d8f8f-dmc9w" podStartSLOduration=1.098185728 podStartE2EDuration="1.098185728s" podCreationTimestamp="2026-05-21 11:52:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:52:49.096589044 +0000 UTC m=+542.525519912" watchObservedRunningTime="2026-05-21 11:52:49.098185728 +0000 UTC m=+542.527116594" May 21 11:52:58.558067 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.558030 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt"] May 21 11:52:58.561962 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.561941 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.564912 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.564893 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 11:52:58.565028 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.564907 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 11:52:58.566056 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.566016 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dwvqw\"" May 21 11:52:58.569235 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.569190 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt"] May 21 11:52:58.594653 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.594624 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:58.594812 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.594673 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:58.599154 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.599133 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:58.670100 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.670053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.670314 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.670117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.670426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.670391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p99mn\" (UniqueName: \"kubernetes.io/projected/77ad1361-4eaf-4a81-9eed-4bef1e245a29-kube-api-access-p99mn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.771892 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.771841 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.771892 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.771897 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.772116 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.771992 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p99mn\" (UniqueName: \"kubernetes.io/projected/77ad1361-4eaf-4a81-9eed-4bef1e245a29-kube-api-access-p99mn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.772246 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.772225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.772345 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.772324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.781483 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.781457 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p99mn\" (UniqueName: \"kubernetes.io/projected/77ad1361-4eaf-4a81-9eed-4bef1e245a29-kube-api-access-p99mn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.872359 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.872321 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:52:58.949477 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.949446 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw"] May 21 11:52:58.954684 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.954659 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:58.966184 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:58.966155 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw"] May 21 11:52:59.013705 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.013677 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt"] May 21 11:52:59.015182 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:52:59.015154 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ad1361_4eaf_4a81_9eed_4bef1e245a29.slice/crio-2ec66daa7064db4d71953961a47fa3fc10788dc647db15b52bbb99d15f4b74ef WatchSource:0}: Error finding container 2ec66daa7064db4d71953961a47fa3fc10788dc647db15b52bbb99d15f4b74ef: Status 404 returned error can't find the container with id 2ec66daa7064db4d71953961a47fa3fc10788dc647db15b52bbb99d15f4b74ef May 21 11:52:59.074332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.074306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdqtn\" (UniqueName: \"kubernetes.io/projected/3a171886-10a9-4896-82d4-fd652b22f915-kube-api-access-kdqtn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.074458 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.074347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.074458 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.074441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.118569 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.118534 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" event={"ID":"77ad1361-4eaf-4a81-9eed-4bef1e245a29","Type":"ContainerStarted","Data":"4522153e7bcb046d3fe51a1065975952e22df60d0079749883d643fded802d7c"} May 21 11:52:59.118569 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.118573 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" event={"ID":"77ad1361-4eaf-4a81-9eed-4bef1e245a29","Type":"ContainerStarted","Data":"2ec66daa7064db4d71953961a47fa3fc10788dc647db15b52bbb99d15f4b74ef"} May 21 11:52:59.123234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.123158 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d968d8f8f-dmc9w" May 21 11:52:59.176777 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.176084 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdqtn\" (UniqueName: \"kubernetes.io/projected/3a171886-10a9-4896-82d4-fd652b22f915-kube-api-access-kdqtn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.176777 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.176169 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.176777 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.176395 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.176777 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.176715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.177191 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.176816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.186879 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.186841 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75958b989d-zmvt4"] May 21 11:52:59.191026 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.190975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdqtn\" (UniqueName: \"kubernetes.io/projected/3a171886-10a9-4896-82d4-fd652b22f915-kube-api-access-kdqtn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.270646 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.270613 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:52:59.360226 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.360197 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm"] May 21 11:52:59.365477 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.365454 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.375594 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.375566 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm"] May 21 11:52:59.422381 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.422354 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw"] May 21 11:52:59.423595 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:52:59.423565 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a171886_10a9_4896_82d4_fd652b22f915.slice/crio-1f207e14bbc24d05b16ee0bfdd0b666707de08555f457d76a8b75c65adf6a298 WatchSource:0}: Error finding container 1f207e14bbc24d05b16ee0bfdd0b666707de08555f457d76a8b75c65adf6a298: Status 404 returned error can't find the container with id 1f207e14bbc24d05b16ee0bfdd0b666707de08555f457d76a8b75c65adf6a298 May 21 11:52:59.479424 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.479397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.479540 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.479465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.479589 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.479559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbrvc\" (UniqueName: \"kubernetes.io/projected/6c509604-719b-4765-bd4e-8020d0ffbe94-kube-api-access-qbrvc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.580043 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.580006 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.580546 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.580068 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.580546 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.580137 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbrvc\" (UniqueName: \"kubernetes.io/projected/6c509604-719b-4765-bd4e-8020d0ffbe94-kube-api-access-qbrvc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.580546 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.580517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.580674 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.580521 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.589754 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.589730 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbrvc\" (UniqueName: \"kubernetes.io/projected/6c509604-719b-4765-bd4e-8020d0ffbe94-kube-api-access-qbrvc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.678561 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.678463 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:52:59.755726 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.755691 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69"] May 21 11:52:59.760732 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.760706 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.766760 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.766705 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69"] May 21 11:52:59.817221 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.817199 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm"] May 21 11:52:59.819363 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:52:59.819333 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c509604_719b_4765_bd4e_8020d0ffbe94.slice/crio-288e840500119fae26892a3cb74b02c32a28d50779530541dbb286abb0a0b30d WatchSource:0}: Error finding container 288e840500119fae26892a3cb74b02c32a28d50779530541dbb286abb0a0b30d: Status 404 returned error can't find the container with id 288e840500119fae26892a3cb74b02c32a28d50779530541dbb286abb0a0b30d May 21 11:52:59.883251 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.883228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.883532 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.883303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.883532 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.883338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grf7r\" (UniqueName: \"kubernetes.io/projected/60bea636-7f60-4af2-bbf6-6211ce84c6da-kube-api-access-grf7r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.984054 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.984016 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.984250 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.984070 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.984250 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.984101 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grf7r\" (UniqueName: \"kubernetes.io/projected/60bea636-7f60-4af2-bbf6-6211ce84c6da-kube-api-access-grf7r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.984411 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.984389 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.984455 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.984424 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:52:59.993728 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:52:59.993707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grf7r\" (UniqueName: \"kubernetes.io/projected/60bea636-7f60-4af2-bbf6-6211ce84c6da-kube-api-access-grf7r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:53:00.074776 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.074739 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:53:00.124908 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.124826 2565 generic.go:358] "Generic (PLEG): container finished" podID="3a171886-10a9-4896-82d4-fd652b22f915" containerID="c2cf5d99cc2c9afa8c7be0340e6b8dc5ff07ce07b183d09e35aa587410372cb8" exitCode=0 May 21 11:53:00.125175 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.124907 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" event={"ID":"3a171886-10a9-4896-82d4-fd652b22f915","Type":"ContainerDied","Data":"c2cf5d99cc2c9afa8c7be0340e6b8dc5ff07ce07b183d09e35aa587410372cb8"} May 21 11:53:00.125175 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.124946 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" event={"ID":"3a171886-10a9-4896-82d4-fd652b22f915","Type":"ContainerStarted","Data":"1f207e14bbc24d05b16ee0bfdd0b666707de08555f457d76a8b75c65adf6a298"} May 21 11:53:00.126907 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.126858 2565 generic.go:358] "Generic (PLEG): container finished" podID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerID="5fde2566d406ce030ccbacc9777a79c1d27a36a3374c63f3bf8fadff8efd7b86" exitCode=0 May 21 11:53:00.127093 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.127076 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" event={"ID":"6c509604-719b-4765-bd4e-8020d0ffbe94","Type":"ContainerDied","Data":"5fde2566d406ce030ccbacc9777a79c1d27a36a3374c63f3bf8fadff8efd7b86"} May 21 11:53:00.127170 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.127104 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" event={"ID":"6c509604-719b-4765-bd4e-8020d0ffbe94","Type":"ContainerStarted","Data":"288e840500119fae26892a3cb74b02c32a28d50779530541dbb286abb0a0b30d"} May 21 11:53:00.129504 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.128551 2565 generic.go:358] "Generic (PLEG): container finished" podID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerID="4522153e7bcb046d3fe51a1065975952e22df60d0079749883d643fded802d7c" exitCode=0 May 21 11:53:00.129504 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.129204 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" event={"ID":"77ad1361-4eaf-4a81-9eed-4bef1e245a29","Type":"ContainerDied","Data":"4522153e7bcb046d3fe51a1065975952e22df60d0079749883d643fded802d7c"} May 21 11:53:00.218808 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:53:00.218762 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bea636_7f60_4af2_bbf6_6211ce84c6da.slice/crio-786caf4b376def1b467c6fa96016d23898bffb9316e261d9c113d1294043fc5d WatchSource:0}: Error finding container 786caf4b376def1b467c6fa96016d23898bffb9316e261d9c113d1294043fc5d: Status 404 returned error can't find the container with id 786caf4b376def1b467c6fa96016d23898bffb9316e261d9c113d1294043fc5d May 21 11:53:00.219369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:00.219341 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69"] May 21 11:53:01.134592 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.134560 2565 generic.go:358] "Generic (PLEG): container finished" podID="3a171886-10a9-4896-82d4-fd652b22f915" containerID="5d74e057afcb360d5dd8075219cc5f7dc1627a8105b63834090104950895487e" exitCode=0 May 21 11:53:01.135021 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.134647 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" event={"ID":"3a171886-10a9-4896-82d4-fd652b22f915","Type":"ContainerDied","Data":"5d74e057afcb360d5dd8075219cc5f7dc1627a8105b63834090104950895487e"} May 21 11:53:01.136478 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.136376 2565 generic.go:358] "Generic (PLEG): container finished" podID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerID="d4606ef3dc38a9943706a19d03a0f13ea361ff5e3b7a82da730fa3b0025a93f0" exitCode=0 May 21 11:53:01.136478 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.136441 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" event={"ID":"6c509604-719b-4765-bd4e-8020d0ffbe94","Type":"ContainerDied","Data":"d4606ef3dc38a9943706a19d03a0f13ea361ff5e3b7a82da730fa3b0025a93f0"} May 21 11:53:01.138028 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.137924 2565 generic.go:358] "Generic (PLEG): container finished" podID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerID="db574c177df22717b1c82446cccbc1da3944a858ac31374b261509a46b4d93ab" exitCode=0 May 21 11:53:01.138028 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.137972 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" event={"ID":"60bea636-7f60-4af2-bbf6-6211ce84c6da","Type":"ContainerDied","Data":"db574c177df22717b1c82446cccbc1da3944a858ac31374b261509a46b4d93ab"} May 21 11:53:01.138028 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.137999 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" event={"ID":"60bea636-7f60-4af2-bbf6-6211ce84c6da","Type":"ContainerStarted","Data":"786caf4b376def1b467c6fa96016d23898bffb9316e261d9c113d1294043fc5d"} May 21 11:53:01.139814 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.139788 2565 generic.go:358] "Generic (PLEG): container finished" podID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerID="42f8222f6ab5bd93be75d37d17135a1279a2cc0682b7d8d19ff3ab45c90637da" exitCode=0 May 21 11:53:01.139934 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:01.139828 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" event={"ID":"77ad1361-4eaf-4a81-9eed-4bef1e245a29","Type":"ContainerDied","Data":"42f8222f6ab5bd93be75d37d17135a1279a2cc0682b7d8d19ff3ab45c90637da"} May 21 11:53:02.146336 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:02.146299 2565 generic.go:358] "Generic (PLEG): container finished" podID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerID="c83cc7ecb9d62ec931cbcd9e47c369a373c6537a092979d343730e6f677c1145" exitCode=0 May 21 11:53:02.146731 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:02.146375 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" event={"ID":"6c509604-719b-4765-bd4e-8020d0ffbe94","Type":"ContainerDied","Data":"c83cc7ecb9d62ec931cbcd9e47c369a373c6537a092979d343730e6f677c1145"} May 21 11:53:02.147989 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:02.147963 2565 generic.go:358] "Generic (PLEG): container finished" podID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerID="e3c65bb30fe1b57c15156045c00e2c4a3dd21b6a89798a14c11a49bea8b9b933" exitCode=0 May 21 11:53:02.148104 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:02.148056 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" event={"ID":"60bea636-7f60-4af2-bbf6-6211ce84c6da","Type":"ContainerDied","Data":"e3c65bb30fe1b57c15156045c00e2c4a3dd21b6a89798a14c11a49bea8b9b933"} May 21 11:53:02.150164 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:02.150136 2565 generic.go:358] "Generic (PLEG): container finished" podID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerID="3fadfdc12caa5ac1a01a34eebbd5672a1c2ef4dc3d75ca457902a37caaa01bea" exitCode=0 May 21 11:53:02.150261 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:02.150219 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" event={"ID":"77ad1361-4eaf-4a81-9eed-4bef1e245a29","Type":"ContainerDied","Data":"3fadfdc12caa5ac1a01a34eebbd5672a1c2ef4dc3d75ca457902a37caaa01bea"} May 21 11:53:02.152144 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:02.152126 2565 generic.go:358] "Generic (PLEG): container finished" podID="3a171886-10a9-4896-82d4-fd652b22f915" containerID="5ec04f23d1c3344745f088bfbc0753af097f39c0ed216f5fab440ace64fdfc98" exitCode=0 May 21 11:53:02.152240 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:02.152163 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" event={"ID":"3a171886-10a9-4896-82d4-fd652b22f915","Type":"ContainerDied","Data":"5ec04f23d1c3344745f088bfbc0753af097f39c0ed216f5fab440ace64fdfc98"} May 21 11:53:03.158369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.158338 2565 generic.go:358] "Generic (PLEG): container finished" podID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerID="12e79de6c14a6b874255142a38ebf183071d38b865ead799e9b83d4d59ed42a2" exitCode=0 May 21 11:53:03.163318 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.163263 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" event={"ID":"60bea636-7f60-4af2-bbf6-6211ce84c6da","Type":"ContainerDied","Data":"12e79de6c14a6b874255142a38ebf183071d38b865ead799e9b83d4d59ed42a2"} May 21 11:53:03.313635 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.313606 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:53:03.353993 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.353966 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:53:03.357490 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.357459 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:53:03.417173 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417086 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-bundle\") pod \"3a171886-10a9-4896-82d4-fd652b22f915\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " May 21 11:53:03.417173 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417125 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-util\") pod \"3a171886-10a9-4896-82d4-fd652b22f915\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " May 21 11:53:03.417430 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417187 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbrvc\" (UniqueName: \"kubernetes.io/projected/6c509604-719b-4765-bd4e-8020d0ffbe94-kube-api-access-qbrvc\") pod \"6c509604-719b-4765-bd4e-8020d0ffbe94\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " May 21 11:53:03.417430 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417226 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-bundle\") pod \"6c509604-719b-4765-bd4e-8020d0ffbe94\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " May 21 11:53:03.417430 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417249 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-util\") pod \"6c509604-719b-4765-bd4e-8020d0ffbe94\" (UID: \"6c509604-719b-4765-bd4e-8020d0ffbe94\") " May 21 11:53:03.417430 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417344 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p99mn\" (UniqueName: \"kubernetes.io/projected/77ad1361-4eaf-4a81-9eed-4bef1e245a29-kube-api-access-p99mn\") pod \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " May 21 11:53:03.417430 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417385 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdqtn\" (UniqueName: \"kubernetes.io/projected/3a171886-10a9-4896-82d4-fd652b22f915-kube-api-access-kdqtn\") pod \"3a171886-10a9-4896-82d4-fd652b22f915\" (UID: \"3a171886-10a9-4896-82d4-fd652b22f915\") " May 21 11:53:03.417430 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417417 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-bundle\") pod \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " May 21 11:53:03.417747 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417444 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-util\") pod \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\" (UID: \"77ad1361-4eaf-4a81-9eed-4bef1e245a29\") " May 21 11:53:03.417795 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417757 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-bundle" (OuterVolumeSpecName: "bundle") pod "3a171886-10a9-4896-82d4-fd652b22f915" (UID: "3a171886-10a9-4896-82d4-fd652b22f915"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:53:03.417795 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.417762 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-bundle" (OuterVolumeSpecName: "bundle") pod "6c509604-719b-4765-bd4e-8020d0ffbe94" (UID: "6c509604-719b-4765-bd4e-8020d0ffbe94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:53:03.418685 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.418657 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-bundle" (OuterVolumeSpecName: "bundle") pod "77ad1361-4eaf-4a81-9eed-4bef1e245a29" (UID: "77ad1361-4eaf-4a81-9eed-4bef1e245a29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:53:03.420069 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.420037 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ad1361-4eaf-4a81-9eed-4bef1e245a29-kube-api-access-p99mn" (OuterVolumeSpecName: "kube-api-access-p99mn") pod "77ad1361-4eaf-4a81-9eed-4bef1e245a29" (UID: "77ad1361-4eaf-4a81-9eed-4bef1e245a29"). InnerVolumeSpecName "kube-api-access-p99mn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:53:03.420181 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.420103 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c509604-719b-4765-bd4e-8020d0ffbe94-kube-api-access-qbrvc" (OuterVolumeSpecName: "kube-api-access-qbrvc") pod "6c509604-719b-4765-bd4e-8020d0ffbe94" (UID: "6c509604-719b-4765-bd4e-8020d0ffbe94"). InnerVolumeSpecName "kube-api-access-qbrvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:53:03.420374 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.420346 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a171886-10a9-4896-82d4-fd652b22f915-kube-api-access-kdqtn" (OuterVolumeSpecName: "kube-api-access-kdqtn") pod "3a171886-10a9-4896-82d4-fd652b22f915" (UID: "3a171886-10a9-4896-82d4-fd652b22f915"). InnerVolumeSpecName "kube-api-access-kdqtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:53:03.423587 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.423564 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-util" (OuterVolumeSpecName: "util") pod "6c509604-719b-4765-bd4e-8020d0ffbe94" (UID: "6c509604-719b-4765-bd4e-8020d0ffbe94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:53:03.423691 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.423674 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-util" (OuterVolumeSpecName: "util") pod "3a171886-10a9-4896-82d4-fd652b22f915" (UID: "3a171886-10a9-4896-82d4-fd652b22f915"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:53:03.424482 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.424461 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-util" (OuterVolumeSpecName: "util") pod "77ad1361-4eaf-4a81-9eed-4bef1e245a29" (UID: "77ad1361-4eaf-4a81-9eed-4bef1e245a29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:53:03.518712 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518669 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdqtn\" (UniqueName: \"kubernetes.io/projected/3a171886-10a9-4896-82d4-fd652b22f915-kube-api-access-kdqtn\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:03.518712 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518705 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:03.518712 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518717 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77ad1361-4eaf-4a81-9eed-4bef1e245a29-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:03.518947 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518727 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:03.518947 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518734 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a171886-10a9-4896-82d4-fd652b22f915-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:03.518947 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518743 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbrvc\" (UniqueName: \"kubernetes.io/projected/6c509604-719b-4765-bd4e-8020d0ffbe94-kube-api-access-qbrvc\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:03.518947 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518753 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:03.518947 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518761 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c509604-719b-4765-bd4e-8020d0ffbe94-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:03.518947 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:03.518768 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p99mn\" (UniqueName: \"kubernetes.io/projected/77ad1361-4eaf-4a81-9eed-4bef1e245a29-kube-api-access-p99mn\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:04.168051 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.168014 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" event={"ID":"77ad1361-4eaf-4a81-9eed-4bef1e245a29","Type":"ContainerDied","Data":"2ec66daa7064db4d71953961a47fa3fc10788dc647db15b52bbb99d15f4b74ef"} May 21 11:53:04.168051 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.168055 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ec66daa7064db4d71953961a47fa3fc10788dc647db15b52bbb99d15f4b74ef" May 21 11:53:04.168551 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.168076 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt" May 21 11:53:04.169914 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.169890 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" May 21 11:53:04.170064 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.169886 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw" event={"ID":"3a171886-10a9-4896-82d4-fd652b22f915","Type":"ContainerDied","Data":"1f207e14bbc24d05b16ee0bfdd0b666707de08555f457d76a8b75c65adf6a298"} May 21 11:53:04.170064 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.170000 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f207e14bbc24d05b16ee0bfdd0b666707de08555f457d76a8b75c65adf6a298" May 21 11:53:04.171666 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.171634 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" event={"ID":"6c509604-719b-4765-bd4e-8020d0ffbe94","Type":"ContainerDied","Data":"288e840500119fae26892a3cb74b02c32a28d50779530541dbb286abb0a0b30d"} May 21 11:53:04.171666 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.171671 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="288e840500119fae26892a3cb74b02c32a28d50779530541dbb286abb0a0b30d" May 21 11:53:04.171666 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.171652 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm" May 21 11:53:04.309953 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.309932 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:53:04.425759 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.425679 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grf7r\" (UniqueName: \"kubernetes.io/projected/60bea636-7f60-4af2-bbf6-6211ce84c6da-kube-api-access-grf7r\") pod \"60bea636-7f60-4af2-bbf6-6211ce84c6da\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " May 21 11:53:04.425901 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.425785 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-util\") pod \"60bea636-7f60-4af2-bbf6-6211ce84c6da\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " May 21 11:53:04.425901 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.425835 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-bundle\") pod \"60bea636-7f60-4af2-bbf6-6211ce84c6da\" (UID: \"60bea636-7f60-4af2-bbf6-6211ce84c6da\") " May 21 11:53:04.426453 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.426401 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-bundle" (OuterVolumeSpecName: "bundle") pod "60bea636-7f60-4af2-bbf6-6211ce84c6da" (UID: "60bea636-7f60-4af2-bbf6-6211ce84c6da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:53:04.427894 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.427870 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60bea636-7f60-4af2-bbf6-6211ce84c6da-kube-api-access-grf7r" (OuterVolumeSpecName: "kube-api-access-grf7r") pod "60bea636-7f60-4af2-bbf6-6211ce84c6da" (UID: "60bea636-7f60-4af2-bbf6-6211ce84c6da"). InnerVolumeSpecName "kube-api-access-grf7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:53:04.431146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.431120 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-util" (OuterVolumeSpecName: "util") pod "60bea636-7f60-4af2-bbf6-6211ce84c6da" (UID: "60bea636-7f60-4af2-bbf6-6211ce84c6da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 11:53:04.526879 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.526843 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grf7r\" (UniqueName: \"kubernetes.io/projected/60bea636-7f60-4af2-bbf6-6211ce84c6da-kube-api-access-grf7r\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:04.526879 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.526875 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-util\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:04.526879 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:04.526887 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bea636-7f60-4af2-bbf6-6211ce84c6da-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:05.176873 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:05.176841 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" event={"ID":"60bea636-7f60-4af2-bbf6-6211ce84c6da","Type":"ContainerDied","Data":"786caf4b376def1b467c6fa96016d23898bffb9316e261d9c113d1294043fc5d"} May 21 11:53:05.176873 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:05.176876 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="786caf4b376def1b467c6fa96016d23898bffb9316e261d9c113d1294043fc5d" May 21 11:53:05.177243 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:05.176855 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69" May 21 11:53:22.524687 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.524650 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8667x"] May 21 11:53:22.525051 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525029 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerName="extract" May 21 11:53:22.525051 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525042 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerName="extract" May 21 11:53:22.525051 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525051 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerName="extract" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525057 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerName="extract" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525071 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a171886-10a9-4896-82d4-fd652b22f915" containerName="extract" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525076 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a171886-10a9-4896-82d4-fd652b22f915" containerName="extract" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525084 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerName="pull" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525093 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerName="pull" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525105 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a171886-10a9-4896-82d4-fd652b22f915" containerName="util" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525111 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a171886-10a9-4896-82d4-fd652b22f915" containerName="util" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525117 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerName="util" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525122 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerName="util" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525128 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerName="util" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525133 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerName="util" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525141 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerName="util" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525146 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerName="util" May 21 11:53:22.525146 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525152 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerName="pull" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525157 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerName="pull" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525164 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerName="pull" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525171 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerName="pull" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525183 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerName="extract" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525188 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerName="extract" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525194 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a171886-10a9-4896-82d4-fd652b22f915" containerName="pull" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525199 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a171886-10a9-4896-82d4-fd652b22f915" containerName="pull" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525264 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a171886-10a9-4896-82d4-fd652b22f915" containerName="extract" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525287 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="60bea636-7f60-4af2-bbf6-6211ce84c6da" containerName="extract" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525294 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="77ad1361-4eaf-4a81-9eed-4bef1e245a29" containerName="extract" May 21 11:53:22.525567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.525303 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c509604-719b-4765-bd4e-8020d0ffbe94" containerName="extract" May 21 11:53:22.528705 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.528687 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8667x" May 21 11:53:22.533654 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.533628 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vc5xd\"" May 21 11:53:22.533766 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.533631 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 11:53:22.534621 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.534605 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 11:53:22.542134 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.542108 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8667x"] May 21 11:53:22.591088 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.591052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkz9m\" (UniqueName: \"kubernetes.io/projected/a31d24e6-c1f3-4645-a279-912e756afdb1-kube-api-access-fkz9m\") pod \"authorino-operator-657f44b778-8667x\" (UID: \"a31d24e6-c1f3-4645-a279-912e756afdb1\") " pod="kuadrant-system/authorino-operator-657f44b778-8667x" May 21 11:53:22.692075 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.692036 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkz9m\" (UniqueName: \"kubernetes.io/projected/a31d24e6-c1f3-4645-a279-912e756afdb1-kube-api-access-fkz9m\") pod \"authorino-operator-657f44b778-8667x\" (UID: \"a31d24e6-c1f3-4645-a279-912e756afdb1\") " pod="kuadrant-system/authorino-operator-657f44b778-8667x" May 21 11:53:22.715528 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.715496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkz9m\" (UniqueName: \"kubernetes.io/projected/a31d24e6-c1f3-4645-a279-912e756afdb1-kube-api-access-fkz9m\") pod \"authorino-operator-657f44b778-8667x\" (UID: \"a31d24e6-c1f3-4645-a279-912e756afdb1\") " pod="kuadrant-system/authorino-operator-657f44b778-8667x" May 21 11:53:22.839692 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:22.839656 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8667x" May 21 11:53:23.000885 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:53:23.000851 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31d24e6_c1f3_4645_a279_912e756afdb1.slice/crio-706ec07556aeb4df593e4b06db8fce23fa08638f372a0caf773a14c1847dd515 WatchSource:0}: Error finding container 706ec07556aeb4df593e4b06db8fce23fa08638f372a0caf773a14c1847dd515: Status 404 returned error can't find the container with id 706ec07556aeb4df593e4b06db8fce23fa08638f372a0caf773a14c1847dd515 May 21 11:53:23.002993 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:23.002972 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8667x"] May 21 11:53:23.245220 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:23.245125 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8667x" event={"ID":"a31d24e6-c1f3-4645-a279-912e756afdb1","Type":"ContainerStarted","Data":"706ec07556aeb4df593e4b06db8fce23fa08638f372a0caf773a14c1847dd515"} May 21 11:53:24.210406 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.210349 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-75958b989d-zmvt4" podUID="fb2a816c-1f49-4b4d-8c82-650ca95ff392" containerName="console" containerID="cri-o://76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4" gracePeriod=15 May 21 11:53:24.676956 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.676933 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75958b989d-zmvt4_fb2a816c-1f49-4b4d-8c82-650ca95ff392/console/0.log" May 21 11:53:24.677099 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.676994 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75958b989d-zmvt4" May 21 11:53:24.710881 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.710825 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-oauth-serving-cert\") pod \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " May 21 11:53:24.710881 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.710864 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-serving-cert\") pod \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " May 21 11:53:24.711025 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.710898 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-service-ca\") pod \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " May 21 11:53:24.711025 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.710925 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-oauth-config\") pod \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " May 21 11:53:24.711025 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.710954 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggs9q\" (UniqueName: \"kubernetes.io/projected/fb2a816c-1f49-4b4d-8c82-650ca95ff392-kube-api-access-ggs9q\") pod \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " May 21 11:53:24.711025 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.710991 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-trusted-ca-bundle\") pod \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " May 21 11:53:24.711209 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.711175 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-config\") pod \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\" (UID: \"fb2a816c-1f49-4b4d-8c82-650ca95ff392\") " May 21 11:53:24.711288 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.711216 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fb2a816c-1f49-4b4d-8c82-650ca95ff392" (UID: "fb2a816c-1f49-4b4d-8c82-650ca95ff392"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:53:24.711574 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.711521 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-service-ca" (OuterVolumeSpecName: "service-ca") pod "fb2a816c-1f49-4b4d-8c82-650ca95ff392" (UID: "fb2a816c-1f49-4b4d-8c82-650ca95ff392"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:53:24.711574 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.711539 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-oauth-serving-cert\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:24.711771 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.711643 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fb2a816c-1f49-4b4d-8c82-650ca95ff392" (UID: "fb2a816c-1f49-4b4d-8c82-650ca95ff392"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:53:24.711996 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.711970 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-config" (OuterVolumeSpecName: "console-config") pod "fb2a816c-1f49-4b4d-8c82-650ca95ff392" (UID: "fb2a816c-1f49-4b4d-8c82-650ca95ff392"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:53:24.713588 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.713565 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fb2a816c-1f49-4b4d-8c82-650ca95ff392" (UID: "fb2a816c-1f49-4b4d-8c82-650ca95ff392"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:53:24.713685 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.713590 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb2a816c-1f49-4b4d-8c82-650ca95ff392-kube-api-access-ggs9q" (OuterVolumeSpecName: "kube-api-access-ggs9q") pod "fb2a816c-1f49-4b4d-8c82-650ca95ff392" (UID: "fb2a816c-1f49-4b4d-8c82-650ca95ff392"). InnerVolumeSpecName "kube-api-access-ggs9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:53:24.713685 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.713614 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fb2a816c-1f49-4b4d-8c82-650ca95ff392" (UID: "fb2a816c-1f49-4b4d-8c82-650ca95ff392"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 11:53:24.812338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.812265 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-serving-cert\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:24.812338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.812333 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-service-ca\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:24.812338 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.812345 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-oauth-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:24.812573 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.812357 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggs9q\" (UniqueName: \"kubernetes.io/projected/fb2a816c-1f49-4b4d-8c82-650ca95ff392-kube-api-access-ggs9q\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:24.812573 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.812369 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-trusted-ca-bundle\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:24.812573 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:24.812379 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb2a816c-1f49-4b4d-8c82-650ca95ff392-console-config\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:53:25.254859 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.254819 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8667x" event={"ID":"a31d24e6-c1f3-4645-a279-912e756afdb1","Type":"ContainerStarted","Data":"60ccbb0cae2df9df5f5bf5785494fcd168c6fa21cdc46ef64f068c3517244879"} May 21 11:53:25.255344 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.254901 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-8667x" May 21 11:53:25.256108 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.256090 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75958b989d-zmvt4_fb2a816c-1f49-4b4d-8c82-650ca95ff392/console/0.log" May 21 11:53:25.256159 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.256128 2565 generic.go:358] "Generic (PLEG): container finished" podID="fb2a816c-1f49-4b4d-8c82-650ca95ff392" containerID="76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4" exitCode=2 May 21 11:53:25.256192 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.256171 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75958b989d-zmvt4" event={"ID":"fb2a816c-1f49-4b4d-8c82-650ca95ff392","Type":"ContainerDied","Data":"76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4"} May 21 11:53:25.256226 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.256194 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75958b989d-zmvt4" event={"ID":"fb2a816c-1f49-4b4d-8c82-650ca95ff392","Type":"ContainerDied","Data":"eb755542e54af432bbe513fd345c38b47e7706e9b372ef5f846dfdbd98ebc8d7"} May 21 11:53:25.256226 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.256213 2565 scope.go:117] "RemoveContainer" containerID="76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4" May 21 11:53:25.256354 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.256214 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75958b989d-zmvt4" May 21 11:53:25.267200 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.267174 2565 scope.go:117] "RemoveContainer" containerID="76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4" May 21 11:53:25.267528 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:53:25.267502 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4\": container with ID starting with 76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4 not found: ID does not exist" containerID="76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4" May 21 11:53:25.267606 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.267538 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4"} err="failed to get container status \"76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4\": rpc error: code = NotFound desc = could not find container \"76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4\": container with ID starting with 76f674b06055f852d7a889fc20e11859db2c97d99cbd2a7607f79f6d26bafec4 not found: ID does not exist" May 21 11:53:25.290929 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.290873 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-8667x" podStartSLOduration=1.581842699 podStartE2EDuration="3.290860301s" podCreationTimestamp="2026-05-21 11:53:22 +0000 UTC" firstStartedPulling="2026-05-21 11:53:23.003007476 +0000 UTC m=+576.431938321" lastFinishedPulling="2026-05-21 11:53:24.712025064 +0000 UTC m=+578.140955923" observedRunningTime="2026-05-21 11:53:25.288906843 +0000 UTC m=+578.717837723" watchObservedRunningTime="2026-05-21 11:53:25.290860301 +0000 UTC m=+578.719791168" May 21 11:53:25.329064 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.328934 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75958b989d-zmvt4"] May 21 11:53:25.358340 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:25.358307 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75958b989d-zmvt4"] May 21 11:53:27.162285 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:27.162240 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb2a816c-1f49-4b4d-8c82-650ca95ff392" path="/var/lib/kubelet/pods/fb2a816c-1f49-4b4d-8c82-650ca95ff392/volumes" May 21 11:53:36.263332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:36.263258 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-8667x" May 21 11:53:47.057569 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:47.057536 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:53:47.058019 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:47.057664 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:53:47.062695 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:47.062677 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:53:47.062881 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:53:47.062865 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:54:16.247765 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.247656 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-47q65"] May 21 11:54:16.248321 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.248252 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb2a816c-1f49-4b4d-8c82-650ca95ff392" containerName="console" May 21 11:54:16.248321 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.248293 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb2a816c-1f49-4b4d-8c82-650ca95ff392" containerName="console" May 21 11:54:16.248477 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.248384 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb2a816c-1f49-4b4d-8c82-650ca95ff392" containerName="console" May 21 11:54:16.251498 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.251476 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:16.254042 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.254019 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 11:54:16.254192 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.254167 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dwvqw\"" May 21 11:54:16.259110 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.259087 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-47q65"] May 21 11:54:16.289628 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.289590 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c296b050-ce6e-457c-bd89-ba30f747c186-config-file\") pod \"limitador-limitador-7d549b5b-47q65\" (UID: \"c296b050-ce6e-457c-bd89-ba30f747c186\") " pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:16.289821 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.289672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxnw\" (UniqueName: \"kubernetes.io/projected/c296b050-ce6e-457c-bd89-ba30f747c186-kube-api-access-mrxnw\") pod \"limitador-limitador-7d549b5b-47q65\" (UID: \"c296b050-ce6e-457c-bd89-ba30f747c186\") " pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:16.348216 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.348185 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-47q65"] May 21 11:54:16.390529 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.390493 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c296b050-ce6e-457c-bd89-ba30f747c186-config-file\") pod \"limitador-limitador-7d549b5b-47q65\" (UID: \"c296b050-ce6e-457c-bd89-ba30f747c186\") " pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:16.390702 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.390572 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxnw\" (UniqueName: \"kubernetes.io/projected/c296b050-ce6e-457c-bd89-ba30f747c186-kube-api-access-mrxnw\") pod \"limitador-limitador-7d549b5b-47q65\" (UID: \"c296b050-ce6e-457c-bd89-ba30f747c186\") " pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:16.391101 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.391082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c296b050-ce6e-457c-bd89-ba30f747c186-config-file\") pod \"limitador-limitador-7d549b5b-47q65\" (UID: \"c296b050-ce6e-457c-bd89-ba30f747c186\") " pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:16.398754 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.398723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxnw\" (UniqueName: \"kubernetes.io/projected/c296b050-ce6e-457c-bd89-ba30f747c186-kube-api-access-mrxnw\") pod \"limitador-limitador-7d549b5b-47q65\" (UID: \"c296b050-ce6e-457c-bd89-ba30f747c186\") " pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:16.563756 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.563729 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:16.705518 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.705486 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-47q65"] May 21 11:54:16.707005 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:54:16.706969 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc296b050_ce6e_457c_bd89_ba30f747c186.slice/crio-fed51a239a6799efa765ea893bd2c0d3111b60c1d89fc10d4970312bafcc98e9 WatchSource:0}: Error finding container fed51a239a6799efa765ea893bd2c0d3111b60c1d89fc10d4970312bafcc98e9: Status 404 returned error can't find the container with id fed51a239a6799efa765ea893bd2c0d3111b60c1d89fc10d4970312bafcc98e9 May 21 11:54:16.708615 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:16.708597 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:54:17.466658 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:17.466616 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" event={"ID":"c296b050-ce6e-457c-bd89-ba30f747c186","Type":"ContainerStarted","Data":"fed51a239a6799efa765ea893bd2c0d3111b60c1d89fc10d4970312bafcc98e9"} May 21 11:54:19.475749 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:19.475711 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" event={"ID":"c296b050-ce6e-457c-bd89-ba30f747c186","Type":"ContainerStarted","Data":"6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f"} May 21 11:54:19.476151 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:19.475782 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:19.492224 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:19.492179 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" podStartSLOduration=0.853221826 podStartE2EDuration="3.492163877s" podCreationTimestamp="2026-05-21 11:54:16 +0000 UTC" firstStartedPulling="2026-05-21 11:54:16.708733224 +0000 UTC m=+630.137664068" lastFinishedPulling="2026-05-21 11:54:19.347675274 +0000 UTC m=+632.776606119" observedRunningTime="2026-05-21 11:54:19.490604447 +0000 UTC m=+632.919535314" watchObservedRunningTime="2026-05-21 11:54:19.492163877 +0000 UTC m=+632.921094787" May 21 11:54:30.480508 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:30.480477 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:30.867533 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:30.867486 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-47q65"] May 21 11:54:30.867760 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:30.867715 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" podUID="c296b050-ce6e-457c-bd89-ba30f747c186" containerName="limitador" containerID="cri-o://6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f" gracePeriod=30 May 21 11:54:31.419316 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.419292 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:31.525015 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.524917 2565 generic.go:358] "Generic (PLEG): container finished" podID="c296b050-ce6e-457c-bd89-ba30f747c186" containerID="6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f" exitCode=0 May 21 11:54:31.525015 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.524980 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" event={"ID":"c296b050-ce6e-457c-bd89-ba30f747c186","Type":"ContainerDied","Data":"6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f"} May 21 11:54:31.525015 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.525011 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" event={"ID":"c296b050-ce6e-457c-bd89-ba30f747c186","Type":"ContainerDied","Data":"fed51a239a6799efa765ea893bd2c0d3111b60c1d89fc10d4970312bafcc98e9"} May 21 11:54:31.525605 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.525027 2565 scope.go:117] "RemoveContainer" containerID="6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f" May 21 11:54:31.525605 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.524985 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-47q65" May 21 11:54:31.533796 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.533775 2565 scope.go:117] "RemoveContainer" containerID="6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f" May 21 11:54:31.534067 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:54:31.534039 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f\": container with ID starting with 6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f not found: ID does not exist" containerID="6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f" May 21 11:54:31.534174 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.534073 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f"} err="failed to get container status \"6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f\": rpc error: code = NotFound desc = could not find container \"6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f\": container with ID starting with 6a0ded4ddd43b940ba2359b81ecd3b9717c37b4ea7b905791e10e2cc5ec05c2f not found: ID does not exist" May 21 11:54:31.536378 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.536361 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrxnw\" (UniqueName: \"kubernetes.io/projected/c296b050-ce6e-457c-bd89-ba30f747c186-kube-api-access-mrxnw\") pod \"c296b050-ce6e-457c-bd89-ba30f747c186\" (UID: \"c296b050-ce6e-457c-bd89-ba30f747c186\") " May 21 11:54:31.536460 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.536450 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c296b050-ce6e-457c-bd89-ba30f747c186-config-file\") pod \"c296b050-ce6e-457c-bd89-ba30f747c186\" (UID: \"c296b050-ce6e-457c-bd89-ba30f747c186\") " May 21 11:54:31.536771 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.536748 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c296b050-ce6e-457c-bd89-ba30f747c186-config-file" (OuterVolumeSpecName: "config-file") pod "c296b050-ce6e-457c-bd89-ba30f747c186" (UID: "c296b050-ce6e-457c-bd89-ba30f747c186"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 11:54:31.538480 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.538460 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c296b050-ce6e-457c-bd89-ba30f747c186-kube-api-access-mrxnw" (OuterVolumeSpecName: "kube-api-access-mrxnw") pod "c296b050-ce6e-457c-bd89-ba30f747c186" (UID: "c296b050-ce6e-457c-bd89-ba30f747c186"). InnerVolumeSpecName "kube-api-access-mrxnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:54:31.637813 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.637772 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c296b050-ce6e-457c-bd89-ba30f747c186-config-file\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:54:31.637813 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.637810 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrxnw\" (UniqueName: \"kubernetes.io/projected/c296b050-ce6e-457c-bd89-ba30f747c186-kube-api-access-mrxnw\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:54:31.847842 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.847526 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-47q65"] May 21 11:54:31.850437 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:31.850414 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-47q65"] May 21 11:54:32.419370 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.419325 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-769jl"] May 21 11:54:32.419808 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.419784 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c296b050-ce6e-457c-bd89-ba30f747c186" containerName="limitador" May 21 11:54:32.419808 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.419808 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c296b050-ce6e-457c-bd89-ba30f747c186" containerName="limitador" May 21 11:54:32.419966 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.419931 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="c296b050-ce6e-457c-bd89-ba30f747c186" containerName="limitador" May 21 11:54:32.424553 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.424530 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:32.428414 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.428385 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qrbqx\"" May 21 11:54:32.428716 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.428649 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 11:54:32.431667 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.431638 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-769jl"] May 21 11:54:32.546205 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.546171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/17b69086-708f-4987-bdfa-c9ab093e5a4a-data\") pod \"postgres-68c4fbbd6f-769jl\" (UID: \"17b69086-708f-4987-bdfa-c9ab093e5a4a\") " pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:32.546205 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.546208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q52jl\" (UniqueName: \"kubernetes.io/projected/17b69086-708f-4987-bdfa-c9ab093e5a4a-kube-api-access-q52jl\") pod \"postgres-68c4fbbd6f-769jl\" (UID: \"17b69086-708f-4987-bdfa-c9ab093e5a4a\") " pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:32.647605 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.647557 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/17b69086-708f-4987-bdfa-c9ab093e5a4a-data\") pod \"postgres-68c4fbbd6f-769jl\" (UID: \"17b69086-708f-4987-bdfa-c9ab093e5a4a\") " pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:32.647785 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.647611 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q52jl\" (UniqueName: \"kubernetes.io/projected/17b69086-708f-4987-bdfa-c9ab093e5a4a-kube-api-access-q52jl\") pod \"postgres-68c4fbbd6f-769jl\" (UID: \"17b69086-708f-4987-bdfa-c9ab093e5a4a\") " pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:32.648028 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.648007 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/17b69086-708f-4987-bdfa-c9ab093e5a4a-data\") pod \"postgres-68c4fbbd6f-769jl\" (UID: \"17b69086-708f-4987-bdfa-c9ab093e5a4a\") " pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:32.656530 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.656498 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q52jl\" (UniqueName: \"kubernetes.io/projected/17b69086-708f-4987-bdfa-c9ab093e5a4a-kube-api-access-q52jl\") pod \"postgres-68c4fbbd6f-769jl\" (UID: \"17b69086-708f-4987-bdfa-c9ab093e5a4a\") " pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:32.737521 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.737410 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:32.873887 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:32.873855 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-769jl"] May 21 11:54:32.876384 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:54:32.876355 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b69086_708f_4987_bdfa_c9ab093e5a4a.slice/crio-88f06471591eb49685f3812ff53d32097bfac7c7c084b0a84bdf859585852611 WatchSource:0}: Error finding container 88f06471591eb49685f3812ff53d32097bfac7c7c084b0a84bdf859585852611: Status 404 returned error can't find the container with id 88f06471591eb49685f3812ff53d32097bfac7c7c084b0a84bdf859585852611 May 21 11:54:33.166522 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:33.166485 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c296b050-ce6e-457c-bd89-ba30f747c186" path="/var/lib/kubelet/pods/c296b050-ce6e-457c-bd89-ba30f747c186/volumes" May 21 11:54:33.537120 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:33.537021 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-769jl" event={"ID":"17b69086-708f-4987-bdfa-c9ab093e5a4a","Type":"ContainerStarted","Data":"88f06471591eb49685f3812ff53d32097bfac7c7c084b0a84bdf859585852611"} May 21 11:54:38.560495 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:38.560451 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-769jl" event={"ID":"17b69086-708f-4987-bdfa-c9ab093e5a4a","Type":"ContainerStarted","Data":"7183a06f2e56b6264e43ab94c53d7a557a7623df02fc722d3ed7b7df1634c42b"} May 21 11:54:38.560947 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:38.560529 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:38.580523 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:38.580430 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-769jl" podStartSLOduration=1.707449654 podStartE2EDuration="6.580410571s" podCreationTimestamp="2026-05-21 11:54:32 +0000 UTC" firstStartedPulling="2026-05-21 11:54:32.877985842 +0000 UTC m=+646.306916686" lastFinishedPulling="2026-05-21 11:54:37.750946758 +0000 UTC m=+651.179877603" observedRunningTime="2026-05-21 11:54:38.579688925 +0000 UTC m=+652.008619818" watchObservedRunningTime="2026-05-21 11:54:38.580410571 +0000 UTC m=+652.009341439" May 21 11:54:44.593550 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:44.593520 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-769jl" May 21 11:54:49.905598 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:49.905559 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-jhbws"] May 21 11:54:50.118426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.118389 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-jhbws"] May 21 11:54:50.118426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.118422 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8594449fdd-mnff7"] May 21 11:54:50.118618 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.118543 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-jhbws" May 21 11:54:50.121380 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.121360 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 11:54:50.121380 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.121371 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7x49w\"" May 21 11:54:50.139520 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.139501 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8594449fdd-mnff7"] May 21 11:54:50.139617 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.139610 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:54:50.180163 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.180090 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-jhbws"] May 21 11:54:50.180377 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:54:50.180358 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sm64s], unattached volumes=[], failed to process volumes=[kube-api-access-sm64s]: context canceled" pod="opendatahub/maas-controller-68fb5d86bc-jhbws" podUID="98489f5e-e460-446e-a239-b02b8439aa0b" May 21 11:54:50.202815 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.202787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm64s\" (UniqueName: \"kubernetes.io/projected/98489f5e-e460-446e-a239-b02b8439aa0b-kube-api-access-sm64s\") pod \"maas-controller-68fb5d86bc-jhbws\" (UID: \"98489f5e-e460-446e-a239-b02b8439aa0b\") " pod="opendatahub/maas-controller-68fb5d86bc-jhbws" May 21 11:54:50.202937 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.202827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqppv\" (UniqueName: \"kubernetes.io/projected/85de46ae-3b11-4ebe-a8b1-25868a0f4085-kube-api-access-jqppv\") pod \"maas-controller-8594449fdd-mnff7\" (UID: \"85de46ae-3b11-4ebe-a8b1-25868a0f4085\") " pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:54:50.212783 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.212758 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74c9f8bd98-cfgpt"] May 21 11:54:50.215200 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.215184 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:54:50.224237 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.224210 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74c9f8bd98-cfgpt"] May 21 11:54:50.304215 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.304177 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sm64s\" (UniqueName: \"kubernetes.io/projected/98489f5e-e460-446e-a239-b02b8439aa0b-kube-api-access-sm64s\") pod \"maas-controller-68fb5d86bc-jhbws\" (UID: \"98489f5e-e460-446e-a239-b02b8439aa0b\") " pod="opendatahub/maas-controller-68fb5d86bc-jhbws" May 21 11:54:50.304215 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.304219 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqppv\" (UniqueName: \"kubernetes.io/projected/85de46ae-3b11-4ebe-a8b1-25868a0f4085-kube-api-access-jqppv\") pod \"maas-controller-8594449fdd-mnff7\" (UID: \"85de46ae-3b11-4ebe-a8b1-25868a0f4085\") " pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:54:50.304510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.304244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5gfb\" (UniqueName: \"kubernetes.io/projected/0352d6a1-36b8-46f0-a0d0-32d8570b7109-kube-api-access-t5gfb\") pod \"maas-controller-74c9f8bd98-cfgpt\" (UID: \"0352d6a1-36b8-46f0-a0d0-32d8570b7109\") " pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:54:50.315001 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.314977 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm64s\" (UniqueName: \"kubernetes.io/projected/98489f5e-e460-446e-a239-b02b8439aa0b-kube-api-access-sm64s\") pod \"maas-controller-68fb5d86bc-jhbws\" (UID: \"98489f5e-e460-446e-a239-b02b8439aa0b\") " pod="opendatahub/maas-controller-68fb5d86bc-jhbws" May 21 11:54:50.315192 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.314981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqppv\" (UniqueName: \"kubernetes.io/projected/85de46ae-3b11-4ebe-a8b1-25868a0f4085-kube-api-access-jqppv\") pod \"maas-controller-8594449fdd-mnff7\" (UID: \"85de46ae-3b11-4ebe-a8b1-25868a0f4085\") " pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:54:50.404759 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.404724 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5gfb\" (UniqueName: \"kubernetes.io/projected/0352d6a1-36b8-46f0-a0d0-32d8570b7109-kube-api-access-t5gfb\") pod \"maas-controller-74c9f8bd98-cfgpt\" (UID: \"0352d6a1-36b8-46f0-a0d0-32d8570b7109\") " pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:54:50.413899 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.413866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5gfb\" (UniqueName: \"kubernetes.io/projected/0352d6a1-36b8-46f0-a0d0-32d8570b7109-kube-api-access-t5gfb\") pod \"maas-controller-74c9f8bd98-cfgpt\" (UID: \"0352d6a1-36b8-46f0-a0d0-32d8570b7109\") " pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:54:50.449920 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.449851 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:54:50.526230 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.526195 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:54:50.601795 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:54:50.601758 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85de46ae_3b11_4ebe_a8b1_25868a0f4085.slice/crio-c159f9b916332fc13d825601c5783369d06978ea386abfa0ef1a1e1a7dc00260 WatchSource:0}: Error finding container c159f9b916332fc13d825601c5783369d06978ea386abfa0ef1a1e1a7dc00260: Status 404 returned error can't find the container with id c159f9b916332fc13d825601c5783369d06978ea386abfa0ef1a1e1a7dc00260 May 21 11:54:50.603402 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.603371 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8594449fdd-mnff7"] May 21 11:54:50.605814 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.605791 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-jhbws" May 21 11:54:50.611906 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.611887 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-jhbws" May 21 11:54:50.672091 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.672062 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74c9f8bd98-cfgpt"] May 21 11:54:50.672984 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:54:50.672960 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0352d6a1_36b8_46f0_a0d0_32d8570b7109.slice/crio-ee1b0de228696854e0525515874c056f2febb0de9e02f20eef463bccb73918cf WatchSource:0}: Error finding container ee1b0de228696854e0525515874c056f2febb0de9e02f20eef463bccb73918cf: Status 404 returned error can't find the container with id ee1b0de228696854e0525515874c056f2febb0de9e02f20eef463bccb73918cf May 21 11:54:50.707182 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.707115 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm64s\" (UniqueName: \"kubernetes.io/projected/98489f5e-e460-446e-a239-b02b8439aa0b-kube-api-access-sm64s\") pod \"98489f5e-e460-446e-a239-b02b8439aa0b\" (UID: \"98489f5e-e460-446e-a239-b02b8439aa0b\") " May 21 11:54:50.709395 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.709368 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98489f5e-e460-446e-a239-b02b8439aa0b-kube-api-access-sm64s" (OuterVolumeSpecName: "kube-api-access-sm64s") pod "98489f5e-e460-446e-a239-b02b8439aa0b" (UID: "98489f5e-e460-446e-a239-b02b8439aa0b"). InnerVolumeSpecName "kube-api-access-sm64s". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:54:50.808053 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:50.808020 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm64s\" (UniqueName: \"kubernetes.io/projected/98489f5e-e460-446e-a239-b02b8439aa0b-kube-api-access-sm64s\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:54:51.615885 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:51.615846 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" event={"ID":"0352d6a1-36b8-46f0-a0d0-32d8570b7109","Type":"ContainerStarted","Data":"ee1b0de228696854e0525515874c056f2febb0de9e02f20eef463bccb73918cf"} May 21 11:54:51.618758 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:51.618291 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-jhbws" May 21 11:54:51.618758 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:51.618480 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8594449fdd-mnff7" event={"ID":"85de46ae-3b11-4ebe-a8b1-25868a0f4085","Type":"ContainerStarted","Data":"c159f9b916332fc13d825601c5783369d06978ea386abfa0ef1a1e1a7dc00260"} May 21 11:54:51.652514 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:51.652472 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-jhbws"] May 21 11:54:51.657042 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:51.657005 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-jhbws"] May 21 11:54:53.162707 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:53.162665 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98489f5e-e460-446e-a239-b02b8439aa0b" path="/var/lib/kubelet/pods/98489f5e-e460-446e-a239-b02b8439aa0b/volumes" May 21 11:54:53.632083 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:53.632049 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" event={"ID":"0352d6a1-36b8-46f0-a0d0-32d8570b7109","Type":"ContainerStarted","Data":"3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3"} May 21 11:54:53.632314 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:53.632177 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:54:53.633490 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:53.633457 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8594449fdd-mnff7" event={"ID":"85de46ae-3b11-4ebe-a8b1-25868a0f4085","Type":"ContainerStarted","Data":"d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21"} May 21 11:54:53.633619 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:53.633572 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:54:53.653751 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:53.653703 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" podStartSLOduration=1.090753481 podStartE2EDuration="3.653689438s" podCreationTimestamp="2026-05-21 11:54:50 +0000 UTC" firstStartedPulling="2026-05-21 11:54:50.674328722 +0000 UTC m=+664.103259572" lastFinishedPulling="2026-05-21 11:54:53.23726468 +0000 UTC m=+666.666195529" observedRunningTime="2026-05-21 11:54:53.650696716 +0000 UTC m=+667.079627658" watchObservedRunningTime="2026-05-21 11:54:53.653689438 +0000 UTC m=+667.082620302" May 21 11:54:53.670873 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:54:53.670792 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-8594449fdd-mnff7" podStartSLOduration=1.0264816429999999 podStartE2EDuration="3.670776878s" podCreationTimestamp="2026-05-21 11:54:50 +0000 UTC" firstStartedPulling="2026-05-21 11:54:50.604291447 +0000 UTC m=+664.033222292" lastFinishedPulling="2026-05-21 11:54:53.248586682 +0000 UTC m=+666.677517527" observedRunningTime="2026-05-21 11:54:53.66812814 +0000 UTC m=+667.097059009" watchObservedRunningTime="2026-05-21 11:54:53.670776878 +0000 UTC m=+667.099707745" May 21 11:55:04.644136 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:04.644100 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:55:04.644544 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:04.644161 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:55:04.701909 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:04.701878 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8594449fdd-mnff7"] May 21 11:55:04.702106 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:04.702084 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-8594449fdd-mnff7" podUID="85de46ae-3b11-4ebe-a8b1-25868a0f4085" containerName="manager" containerID="cri-o://d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21" gracePeriod=30 May 21 11:55:04.897863 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:04.897786 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-698fdfdc7b-wnts2"] May 21 11:55:04.901429 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:04.901410 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:55:04.909152 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:04.909086 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698fdfdc7b-wnts2"] May 21 11:55:04.952384 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:04.952361 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:55:05.048193 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.048153 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqppv\" (UniqueName: \"kubernetes.io/projected/85de46ae-3b11-4ebe-a8b1-25868a0f4085-kube-api-access-jqppv\") pod \"85de46ae-3b11-4ebe-a8b1-25868a0f4085\" (UID: \"85de46ae-3b11-4ebe-a8b1-25868a0f4085\") " May 21 11:55:05.048479 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.048458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdls\" (UniqueName: \"kubernetes.io/projected/ba5b019f-db11-492f-ad4d-d9221f86449d-kube-api-access-rfdls\") pod \"maas-controller-698fdfdc7b-wnts2\" (UID: \"ba5b019f-db11-492f-ad4d-d9221f86449d\") " pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:55:05.050645 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.050622 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85de46ae-3b11-4ebe-a8b1-25868a0f4085-kube-api-access-jqppv" (OuterVolumeSpecName: "kube-api-access-jqppv") pod "85de46ae-3b11-4ebe-a8b1-25868a0f4085" (UID: "85de46ae-3b11-4ebe-a8b1-25868a0f4085"). InnerVolumeSpecName "kube-api-access-jqppv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:55:05.149481 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.149363 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdls\" (UniqueName: \"kubernetes.io/projected/ba5b019f-db11-492f-ad4d-d9221f86449d-kube-api-access-rfdls\") pod \"maas-controller-698fdfdc7b-wnts2\" (UID: \"ba5b019f-db11-492f-ad4d-d9221f86449d\") " pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:55:05.149683 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.149578 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqppv\" (UniqueName: \"kubernetes.io/projected/85de46ae-3b11-4ebe-a8b1-25868a0f4085-kube-api-access-jqppv\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:55:05.158478 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.158452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdls\" (UniqueName: \"kubernetes.io/projected/ba5b019f-db11-492f-ad4d-d9221f86449d-kube-api-access-rfdls\") pod \"maas-controller-698fdfdc7b-wnts2\" (UID: \"ba5b019f-db11-492f-ad4d-d9221f86449d\") " pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:55:05.214065 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.214025 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:55:05.358518 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.358491 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698fdfdc7b-wnts2"] May 21 11:55:05.360294 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:55:05.360244 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5b019f_db11_492f_ad4d_d9221f86449d.slice/crio-0152ac955b1944bc9e85b1dd058fa260ae6dbba815bb2111ac0facfa820268ef WatchSource:0}: Error finding container 0152ac955b1944bc9e85b1dd058fa260ae6dbba815bb2111ac0facfa820268ef: Status 404 returned error can't find the container with id 0152ac955b1944bc9e85b1dd058fa260ae6dbba815bb2111ac0facfa820268ef May 21 11:55:05.681418 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.681384 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" event={"ID":"ba5b019f-db11-492f-ad4d-d9221f86449d","Type":"ContainerStarted","Data":"0152ac955b1944bc9e85b1dd058fa260ae6dbba815bb2111ac0facfa820268ef"} May 21 11:55:05.682597 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.682568 2565 generic.go:358] "Generic (PLEG): container finished" podID="85de46ae-3b11-4ebe-a8b1-25868a0f4085" containerID="d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21" exitCode=0 May 21 11:55:05.682672 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.682641 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8594449fdd-mnff7" May 21 11:55:05.682723 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.682663 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8594449fdd-mnff7" event={"ID":"85de46ae-3b11-4ebe-a8b1-25868a0f4085","Type":"ContainerDied","Data":"d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21"} May 21 11:55:05.682763 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.682708 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8594449fdd-mnff7" event={"ID":"85de46ae-3b11-4ebe-a8b1-25868a0f4085","Type":"ContainerDied","Data":"c159f9b916332fc13d825601c5783369d06978ea386abfa0ef1a1e1a7dc00260"} May 21 11:55:05.682763 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.682736 2565 scope.go:117] "RemoveContainer" containerID="d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21" May 21 11:55:05.692136 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.692109 2565 scope.go:117] "RemoveContainer" containerID="d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21" May 21 11:55:05.692401 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:55:05.692379 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21\": container with ID starting with d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21 not found: ID does not exist" containerID="d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21" May 21 11:55:05.692496 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.692407 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21"} err="failed to get container status \"d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21\": rpc error: code = NotFound desc = could not find container \"d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21\": container with ID starting with d95c3f9515eb00e7d085dcfe804dcd47a82a9947ca608bebe8c2a3e3ff9e8d21 not found: ID does not exist" May 21 11:55:05.702330 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.702309 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8594449fdd-mnff7"] May 21 11:55:05.708056 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:05.708035 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8594449fdd-mnff7"] May 21 11:55:06.688857 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:06.688817 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" event={"ID":"ba5b019f-db11-492f-ad4d-d9221f86449d","Type":"ContainerStarted","Data":"c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790"} May 21 11:55:06.689236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:06.688961 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:55:06.707105 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:06.707054 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" podStartSLOduration=2.395296432 podStartE2EDuration="2.707039682s" podCreationTimestamp="2026-05-21 11:55:04 +0000 UTC" firstStartedPulling="2026-05-21 11:55:05.361617423 +0000 UTC m=+678.790548269" lastFinishedPulling="2026-05-21 11:55:05.673360671 +0000 UTC m=+679.102291519" observedRunningTime="2026-05-21 11:55:06.704846431 +0000 UTC m=+680.133777299" watchObservedRunningTime="2026-05-21 11:55:06.707039682 +0000 UTC m=+680.135970547" May 21 11:55:07.161180 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:07.161137 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85de46ae-3b11-4ebe-a8b1-25868a0f4085" path="/var/lib/kubelet/pods/85de46ae-3b11-4ebe-a8b1-25868a0f4085/volumes" May 21 11:55:17.700593 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:17.700551 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:55:17.746721 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:17.746673 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74c9f8bd98-cfgpt"] May 21 11:55:17.746953 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:17.746930 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" podUID="0352d6a1-36b8-46f0-a0d0-32d8570b7109" containerName="manager" containerID="cri-o://3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3" gracePeriod=30 May 21 11:55:17.994813 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:17.994789 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:55:18.174138 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.174097 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5gfb\" (UniqueName: \"kubernetes.io/projected/0352d6a1-36b8-46f0-a0d0-32d8570b7109-kube-api-access-t5gfb\") pod \"0352d6a1-36b8-46f0-a0d0-32d8570b7109\" (UID: \"0352d6a1-36b8-46f0-a0d0-32d8570b7109\") " May 21 11:55:18.176262 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.176231 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0352d6a1-36b8-46f0-a0d0-32d8570b7109-kube-api-access-t5gfb" (OuterVolumeSpecName: "kube-api-access-t5gfb") pod "0352d6a1-36b8-46f0-a0d0-32d8570b7109" (UID: "0352d6a1-36b8-46f0-a0d0-32d8570b7109"). InnerVolumeSpecName "kube-api-access-t5gfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:55:18.275532 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.275449 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5gfb\" (UniqueName: \"kubernetes.io/projected/0352d6a1-36b8-46f0-a0d0-32d8570b7109-kube-api-access-t5gfb\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:55:18.740513 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.740479 2565 generic.go:358] "Generic (PLEG): container finished" podID="0352d6a1-36b8-46f0-a0d0-32d8570b7109" containerID="3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3" exitCode=0 May 21 11:55:18.740880 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.740537 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" May 21 11:55:18.740880 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.740564 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" event={"ID":"0352d6a1-36b8-46f0-a0d0-32d8570b7109","Type":"ContainerDied","Data":"3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3"} May 21 11:55:18.740880 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.740601 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c9f8bd98-cfgpt" event={"ID":"0352d6a1-36b8-46f0-a0d0-32d8570b7109","Type":"ContainerDied","Data":"ee1b0de228696854e0525515874c056f2febb0de9e02f20eef463bccb73918cf"} May 21 11:55:18.740880 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.740616 2565 scope.go:117] "RemoveContainer" containerID="3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3" May 21 11:55:18.749951 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.749823 2565 scope.go:117] "RemoveContainer" containerID="3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3" May 21 11:55:18.750109 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:55:18.750081 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3\": container with ID starting with 3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3 not found: ID does not exist" containerID="3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3" May 21 11:55:18.750152 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.750118 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3"} err="failed to get container status \"3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3\": rpc error: code = NotFound desc = could not find container \"3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3\": container with ID starting with 3c22993f29c577fde50d5c887491a070b8d59c7752510b7bafafbe95397985e3 not found: ID does not exist" May 21 11:55:18.762949 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.762926 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74c9f8bd98-cfgpt"] May 21 11:55:18.767607 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:18.767586 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74c9f8bd98-cfgpt"] May 21 11:55:19.161257 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:19.161224 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0352d6a1-36b8-46f0-a0d0-32d8570b7109" path="/var/lib/kubelet/pods/0352d6a1-36b8-46f0-a0d0-32d8570b7109/volumes" May 21 11:55:40.223777 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.223692 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-844b96754f-5pkm9"] May 21 11:55:40.224138 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.224117 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85de46ae-3b11-4ebe-a8b1-25868a0f4085" containerName="manager" May 21 11:55:40.224138 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.224130 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85de46ae-3b11-4ebe-a8b1-25868a0f4085" containerName="manager" May 21 11:55:40.224210 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.224141 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0352d6a1-36b8-46f0-a0d0-32d8570b7109" containerName="manager" May 21 11:55:40.224210 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.224149 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0352d6a1-36b8-46f0-a0d0-32d8570b7109" containerName="manager" May 21 11:55:40.224302 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.224214 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="0352d6a1-36b8-46f0-a0d0-32d8570b7109" containerName="manager" May 21 11:55:40.224302 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.224223 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="85de46ae-3b11-4ebe-a8b1-25868a0f4085" containerName="manager" May 21 11:55:40.227483 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.227463 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:40.230075 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.230057 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 11:55:40.230188 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.230155 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bsrg7\"" May 21 11:55:40.237191 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.237166 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-844b96754f-5pkm9"] May 21 11:55:40.282547 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.282504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2d44ed-230a-42bd-a76c-ed1e78bb9447-maas-api-tls\") pod \"maas-api-844b96754f-5pkm9\" (UID: \"9c2d44ed-230a-42bd-a76c-ed1e78bb9447\") " pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:40.282755 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.282564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbddx\" (UniqueName: \"kubernetes.io/projected/9c2d44ed-230a-42bd-a76c-ed1e78bb9447-kube-api-access-xbddx\") pod \"maas-api-844b96754f-5pkm9\" (UID: \"9c2d44ed-230a-42bd-a76c-ed1e78bb9447\") " pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:40.384058 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.384016 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2d44ed-230a-42bd-a76c-ed1e78bb9447-maas-api-tls\") pod \"maas-api-844b96754f-5pkm9\" (UID: \"9c2d44ed-230a-42bd-a76c-ed1e78bb9447\") " pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:40.384058 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.384059 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbddx\" (UniqueName: \"kubernetes.io/projected/9c2d44ed-230a-42bd-a76c-ed1e78bb9447-kube-api-access-xbddx\") pod \"maas-api-844b96754f-5pkm9\" (UID: \"9c2d44ed-230a-42bd-a76c-ed1e78bb9447\") " pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:40.386689 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.386655 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2d44ed-230a-42bd-a76c-ed1e78bb9447-maas-api-tls\") pod \"maas-api-844b96754f-5pkm9\" (UID: \"9c2d44ed-230a-42bd-a76c-ed1e78bb9447\") " pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:40.394123 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.394075 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbddx\" (UniqueName: \"kubernetes.io/projected/9c2d44ed-230a-42bd-a76c-ed1e78bb9447-kube-api-access-xbddx\") pod \"maas-api-844b96754f-5pkm9\" (UID: \"9c2d44ed-230a-42bd-a76c-ed1e78bb9447\") " pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:40.539107 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.539024 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:40.606461 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.606432 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-9d6tz"] May 21 11:55:40.610937 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.610917 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" May 21 11:55:40.614904 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.614884 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dqbjb\"" May 21 11:55:40.615118 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.615105 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 11:55:40.622662 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.622633 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-9d6tz"] May 21 11:55:40.704643 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.704612 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-844b96754f-5pkm9"] May 21 11:55:40.705115 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.705090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgl2n\" (UniqueName: \"kubernetes.io/projected/abdf72ef-d972-4630-afce-31e9b1b3a90b-kube-api-access-zgl2n\") pod \"payload-processing-58b6c8fdc7-9d6tz\" (UID: \"abdf72ef-d972-4630-afce-31e9b1b3a90b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" May 21 11:55:40.806746 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.806650 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgl2n\" (UniqueName: \"kubernetes.io/projected/abdf72ef-d972-4630-afce-31e9b1b3a90b-kube-api-access-zgl2n\") pod \"payload-processing-58b6c8fdc7-9d6tz\" (UID: \"abdf72ef-d972-4630-afce-31e9b1b3a90b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" May 21 11:55:40.817847 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.817813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgl2n\" (UniqueName: \"kubernetes.io/projected/abdf72ef-d972-4630-afce-31e9b1b3a90b-kube-api-access-zgl2n\") pod \"payload-processing-58b6c8fdc7-9d6tz\" (UID: \"abdf72ef-d972-4630-afce-31e9b1b3a90b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" May 21 11:55:40.834644 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.834609 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-844b96754f-5pkm9" event={"ID":"9c2d44ed-230a-42bd-a76c-ed1e78bb9447","Type":"ContainerStarted","Data":"cffc48484a1e07b6e5da7fb66d43f17044cd3a2809c892b0d021fa8f00632d05"} May 21 11:55:40.925186 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:40.925148 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" May 21 11:55:41.062783 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:41.062754 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-9d6tz"] May 21 11:55:41.064130 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:55:41.064097 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdf72ef_d972_4630_afce_31e9b1b3a90b.slice/crio-86b5048ed196d2464e04d8a73232822626d916e037c39c7aa4bbfe648419dd53 WatchSource:0}: Error finding container 86b5048ed196d2464e04d8a73232822626d916e037c39c7aa4bbfe648419dd53: Status 404 returned error can't find the container with id 86b5048ed196d2464e04d8a73232822626d916e037c39c7aa4bbfe648419dd53 May 21 11:55:41.843623 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:41.843535 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" event={"ID":"abdf72ef-d972-4630-afce-31e9b1b3a90b","Type":"ContainerStarted","Data":"86b5048ed196d2464e04d8a73232822626d916e037c39c7aa4bbfe648419dd53"} May 21 11:55:42.848971 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:42.848934 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-844b96754f-5pkm9" event={"ID":"9c2d44ed-230a-42bd-a76c-ed1e78bb9447","Type":"ContainerStarted","Data":"92b1e36464631adaa41aa1655ff85189cc5d3a4f7d3a49ec622eb0d0d44821e5"} May 21 11:55:42.849432 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:42.848995 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:42.850421 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:42.850396 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" event={"ID":"abdf72ef-d972-4630-afce-31e9b1b3a90b","Type":"ContainerStarted","Data":"e9a7e007d68335a1f78cc67ba4234917698da105193d9e6a67a1253867a0aeba"} May 21 11:55:42.850556 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:42.850482 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" May 21 11:55:42.866984 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:42.866934 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-844b96754f-5pkm9" podStartSLOduration=0.882323226 podStartE2EDuration="2.866919912s" podCreationTimestamp="2026-05-21 11:55:40 +0000 UTC" firstStartedPulling="2026-05-21 11:55:40.711669758 +0000 UTC m=+714.140600609" lastFinishedPulling="2026-05-21 11:55:42.696266446 +0000 UTC m=+716.125197295" observedRunningTime="2026-05-21 11:55:42.865401794 +0000 UTC m=+716.294332653" watchObservedRunningTime="2026-05-21 11:55:42.866919912 +0000 UTC m=+716.295850778" May 21 11:55:42.886945 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:42.886890 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" podStartSLOduration=1.253966178 podStartE2EDuration="2.886876592s" podCreationTimestamp="2026-05-21 11:55:40 +0000 UTC" firstStartedPulling="2026-05-21 11:55:41.06601105 +0000 UTC m=+714.494941895" lastFinishedPulling="2026-05-21 11:55:42.698921464 +0000 UTC m=+716.127852309" observedRunningTime="2026-05-21 11:55:42.884434749 +0000 UTC m=+716.313365617" watchObservedRunningTime="2026-05-21 11:55:42.886876592 +0000 UTC m=+716.315807458" May 21 11:55:48.860345 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:48.860315 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-844b96754f-5pkm9" May 21 11:55:53.856855 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:55:53.856820 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-9d6tz" May 21 11:56:07.121574 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.121536 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz"] May 21 11:56:07.125375 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.125352 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.129426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.129400 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 11:56:07.129426 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.129401 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 11:56:07.129637 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.129449 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 11:56:07.129637 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.129537 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cd26v\"" May 21 11:56:07.135602 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.135580 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz"] May 21 11:56:07.141634 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.141614 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppbg\" (UniqueName: \"kubernetes.io/projected/4f9e6486-4260-4d8a-a42b-bcce4669654e-kube-api-access-nppbg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.141756 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.141665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.141818 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.141752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9e6486-4260-4d8a-a42b-bcce4669654e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.141818 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.141775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.141818 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.141803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.141961 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.141900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.243395 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.243366 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.243565 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.243434 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nppbg\" (UniqueName: \"kubernetes.io/projected/4f9e6486-4260-4d8a-a42b-bcce4669654e-kube-api-access-nppbg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.243565 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.243491 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.243565 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.243541 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9e6486-4260-4d8a-a42b-bcce4669654e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.243805 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.243568 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.243805 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.243608 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.243928 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.243805 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.244019 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.243994 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.244236 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.244213 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.246065 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.246041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9e6486-4260-4d8a-a42b-bcce4669654e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.246329 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.246311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9e6486-4260-4d8a-a42b-bcce4669654e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.252670 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.252649 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppbg\" (UniqueName: \"kubernetes.io/projected/4f9e6486-4260-4d8a-a42b-bcce4669654e-kube-api-access-nppbg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz\" (UID: \"4f9e6486-4260-4d8a-a42b-bcce4669654e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.436740 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.436656 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:07.587130 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.587096 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz"] May 21 11:56:07.588835 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:56:07.588807 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9e6486_4260_4d8a_a42b_bcce4669654e.slice/crio-4648e2e371a8701e17e4dabb9448b9037a243ba51be5bbb37d7c081e455d38d3 WatchSource:0}: Error finding container 4648e2e371a8701e17e4dabb9448b9037a243ba51be5bbb37d7c081e455d38d3: Status 404 returned error can't find the container with id 4648e2e371a8701e17e4dabb9448b9037a243ba51be5bbb37d7c081e455d38d3 May 21 11:56:07.955835 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:07.955794 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" event={"ID":"4f9e6486-4260-4d8a-a42b-bcce4669654e","Type":"ContainerStarted","Data":"4648e2e371a8701e17e4dabb9448b9037a243ba51be5bbb37d7c081e455d38d3"} May 21 11:56:12.987865 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:12.987821 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" event={"ID":"4f9e6486-4260-4d8a-a42b-bcce4669654e","Type":"ContainerStarted","Data":"0737c1472bafd92eef2a87f91ee201d7461d5c40a84e1f8d2a200d8b9a465e92"} May 21 11:56:21.427182 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.427146 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc"] May 21 11:56:21.430981 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.430961 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.434418 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.434391 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 11:56:21.441896 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.441867 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc"] May 21 11:56:21.486567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.486529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5bh\" (UniqueName: \"kubernetes.io/projected/fc19fea5-185e-40a0-a486-564ba8bb8009-kube-api-access-ft5bh\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.486567 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.486583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.486826 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.486620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.486826 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.486672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.486826 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.486751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc19fea5-185e-40a0-a486-564ba8bb8009-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.486826 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.486815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588117 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588081 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5bh\" (UniqueName: \"kubernetes.io/projected/fc19fea5-185e-40a0-a486-564ba8bb8009-kube-api-access-ft5bh\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588128 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588156 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588201 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588226 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc19fea5-185e-40a0-a486-564ba8bb8009-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588332 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588294 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588613 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588674 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588607 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.588766 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.588676 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.590839 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.590813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc19fea5-185e-40a0-a486-564ba8bb8009-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.591047 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.591026 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc19fea5-185e-40a0-a486-564ba8bb8009-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.597484 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.597457 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5bh\" (UniqueName: \"kubernetes.io/projected/fc19fea5-185e-40a0-a486-564ba8bb8009-kube-api-access-ft5bh\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jpvdc\" (UID: \"fc19fea5-185e-40a0-a486-564ba8bb8009\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.743783 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.743683 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:21.897165 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:21.897138 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc"] May 21 11:56:21.899107 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:56:21.899070 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc19fea5_185e_40a0_a486_564ba8bb8009.slice/crio-18006adb7364ee2943044e1d87f1701071b947c1371a7b1232b87af5d3a7cb50 WatchSource:0}: Error finding container 18006adb7364ee2943044e1d87f1701071b947c1371a7b1232b87af5d3a7cb50: Status 404 returned error can't find the container with id 18006adb7364ee2943044e1d87f1701071b947c1371a7b1232b87af5d3a7cb50 May 21 11:56:22.027090 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:22.027001 2565 generic.go:358] "Generic (PLEG): container finished" podID="4f9e6486-4260-4d8a-a42b-bcce4669654e" containerID="0737c1472bafd92eef2a87f91ee201d7461d5c40a84e1f8d2a200d8b9a465e92" exitCode=0 May 21 11:56:22.027090 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:22.027078 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" event={"ID":"4f9e6486-4260-4d8a-a42b-bcce4669654e","Type":"ContainerDied","Data":"0737c1472bafd92eef2a87f91ee201d7461d5c40a84e1f8d2a200d8b9a465e92"} May 21 11:56:22.028739 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:22.028709 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" event={"ID":"fc19fea5-185e-40a0-a486-564ba8bb8009","Type":"ContainerStarted","Data":"c1c102e22cea20f276a7b763caeb6d660b85fb74102f9b0a694d6f6077062ba9"} May 21 11:56:22.028845 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:22.028748 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" event={"ID":"fc19fea5-185e-40a0-a486-564ba8bb8009","Type":"ContainerStarted","Data":"18006adb7364ee2943044e1d87f1701071b947c1371a7b1232b87af5d3a7cb50"} May 21 11:56:24.040804 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:24.040761 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" event={"ID":"4f9e6486-4260-4d8a-a42b-bcce4669654e","Type":"ContainerStarted","Data":"3f88cc90e60ccc3767fe0193d5e772dcf8b0fb8b75813f0f6da2bfe532563060"} May 21 11:56:24.041290 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:24.040969 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:24.066579 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:24.066516 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" podStartSLOduration=1.167113533 podStartE2EDuration="17.066495752s" podCreationTimestamp="2026-05-21 11:56:07 +0000 UTC" firstStartedPulling="2026-05-21 11:56:07.590980425 +0000 UTC m=+741.019911271" lastFinishedPulling="2026-05-21 11:56:23.490362638 +0000 UTC m=+756.919293490" observedRunningTime="2026-05-21 11:56:24.063479501 +0000 UTC m=+757.492410367" watchObservedRunningTime="2026-05-21 11:56:24.066495752 +0000 UTC m=+757.495426620" May 21 11:56:28.057327 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.057264 2565 generic.go:358] "Generic (PLEG): container finished" podID="fc19fea5-185e-40a0-a486-564ba8bb8009" containerID="c1c102e22cea20f276a7b763caeb6d660b85fb74102f9b0a694d6f6077062ba9" exitCode=0 May 21 11:56:28.057726 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.057339 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" event={"ID":"fc19fea5-185e-40a0-a486-564ba8bb8009","Type":"ContainerDied","Data":"c1c102e22cea20f276a7b763caeb6d660b85fb74102f9b0a694d6f6077062ba9"} May 21 11:56:28.319981 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.319950 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb"] May 21 11:56:28.324967 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.324944 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.327623 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.327602 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 11:56:28.334334 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.334309 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb"] May 21 11:56:28.458229 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.458195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.458397 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.458303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfnmb\" (UniqueName: \"kubernetes.io/projected/54a59ac9-8545-412f-a14c-b892da3b589c-kube-api-access-bfnmb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.458397 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.458345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.458475 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.458428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54a59ac9-8545-412f-a14c-b892da3b589c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.458510 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.458489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.458544 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.458515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560017 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.559981 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54a59ac9-8545-412f-a14c-b892da3b589c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560017 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.560026 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.560046 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.560081 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.560130 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfnmb\" (UniqueName: \"kubernetes.io/projected/54a59ac9-8545-412f-a14c-b892da3b589c-kube-api-access-bfnmb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.560165 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560531 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.560495 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560673 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.560548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.560673 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.560611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.562622 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.562599 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54a59ac9-8545-412f-a14c-b892da3b589c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.562730 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.562715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54a59ac9-8545-412f-a14c-b892da3b589c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.568643 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.568623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfnmb\" (UniqueName: \"kubernetes.io/projected/54a59ac9-8545-412f-a14c-b892da3b589c-kube-api-access-bfnmb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb\" (UID: \"54a59ac9-8545-412f-a14c-b892da3b589c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.637234 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.637141 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:28.783891 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:28.783864 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb"] May 21 11:56:28.785045 ip-10-0-129-255 kubenswrapper[2565]: W0521 11:56:28.785022 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a59ac9_8545_412f_a14c_b892da3b589c.slice/crio-37f7b675504e5b8416eff7251ca42fee6087b492f33234ef2dc59217d6b19d49 WatchSource:0}: Error finding container 37f7b675504e5b8416eff7251ca42fee6087b492f33234ef2dc59217d6b19d49: Status 404 returned error can't find the container with id 37f7b675504e5b8416eff7251ca42fee6087b492f33234ef2dc59217d6b19d49 May 21 11:56:29.063516 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:29.063484 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" event={"ID":"fc19fea5-185e-40a0-a486-564ba8bb8009","Type":"ContainerStarted","Data":"8b06b9249efa51bd33a8468203e7c46fa29286fc6fdbc72eee6a3ad4272b7899"} May 21 11:56:29.063924 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:29.063728 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:29.064931 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:29.064890 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" event={"ID":"54a59ac9-8545-412f-a14c-b892da3b589c","Type":"ContainerStarted","Data":"7c32dffa8d47a7bec7eb37e7df65b5796ae17b6780cc5228b1b84b34e6a7d0ba"} May 21 11:56:29.064931 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:29.064926 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" event={"ID":"54a59ac9-8545-412f-a14c-b892da3b589c","Type":"ContainerStarted","Data":"37f7b675504e5b8416eff7251ca42fee6087b492f33234ef2dc59217d6b19d49"} May 21 11:56:29.087171 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:29.087112 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" podStartSLOduration=7.736256678 podStartE2EDuration="8.087097204s" podCreationTimestamp="2026-05-21 11:56:21 +0000 UTC" firstStartedPulling="2026-05-21 11:56:28.05798268 +0000 UTC m=+761.486913525" lastFinishedPulling="2026-05-21 11:56:28.408823204 +0000 UTC m=+761.837754051" observedRunningTime="2026-05-21 11:56:29.083588515 +0000 UTC m=+762.512519381" watchObservedRunningTime="2026-05-21 11:56:29.087097204 +0000 UTC m=+762.516028071" May 21 11:56:35.058949 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:35.058912 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz" May 21 11:56:35.101156 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:35.101123 2565 generic.go:358] "Generic (PLEG): container finished" podID="54a59ac9-8545-412f-a14c-b892da3b589c" containerID="7c32dffa8d47a7bec7eb37e7df65b5796ae17b6780cc5228b1b84b34e6a7d0ba" exitCode=0 May 21 11:56:35.101345 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:35.101198 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" event={"ID":"54a59ac9-8545-412f-a14c-b892da3b589c","Type":"ContainerDied","Data":"7c32dffa8d47a7bec7eb37e7df65b5796ae17b6780cc5228b1b84b34e6a7d0ba"} May 21 11:56:36.107519 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:36.107474 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" event={"ID":"54a59ac9-8545-412f-a14c-b892da3b589c","Type":"ContainerStarted","Data":"ba23fa4a58c2d0319cf7a63874b0bfdde5b9de25c8bff4dd92c431655c8a813d"} May 21 11:56:36.108019 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:36.107731 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:56:36.133841 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:36.132067 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" podStartSLOduration=7.579197671 podStartE2EDuration="8.132048321s" podCreationTimestamp="2026-05-21 11:56:28 +0000 UTC" firstStartedPulling="2026-05-21 11:56:35.102149072 +0000 UTC m=+768.531079934" lastFinishedPulling="2026-05-21 11:56:35.654999735 +0000 UTC m=+769.083930584" observedRunningTime="2026-05-21 11:56:36.128465971 +0000 UTC m=+769.557396839" watchObservedRunningTime="2026-05-21 11:56:36.132048321 +0000 UTC m=+769.560979191" May 21 11:56:40.084289 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:40.084240 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jpvdc" May 21 11:56:47.125340 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:56:47.125305 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb" May 21 11:58:38.612369 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:38.612291 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-698fdfdc7b-wnts2"] May 21 11:58:38.612888 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:38.612544 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" podUID="ba5b019f-db11-492f-ad4d-d9221f86449d" containerName="manager" containerID="cri-o://c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790" gracePeriod=30 May 21 11:58:38.861368 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:38.861338 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:58:38.920558 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:38.920479 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfdls\" (UniqueName: \"kubernetes.io/projected/ba5b019f-db11-492f-ad4d-d9221f86449d-kube-api-access-rfdls\") pod \"ba5b019f-db11-492f-ad4d-d9221f86449d\" (UID: \"ba5b019f-db11-492f-ad4d-d9221f86449d\") " May 21 11:58:38.922810 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:38.922778 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba5b019f-db11-492f-ad4d-d9221f86449d-kube-api-access-rfdls" (OuterVolumeSpecName: "kube-api-access-rfdls") pod "ba5b019f-db11-492f-ad4d-d9221f86449d" (UID: "ba5b019f-db11-492f-ad4d-d9221f86449d"). InnerVolumeSpecName "kube-api-access-rfdls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:58:39.021109 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.021081 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfdls\" (UniqueName: \"kubernetes.io/projected/ba5b019f-db11-492f-ad4d-d9221f86449d-kube-api-access-rfdls\") on node \"ip-10-0-129-255.ec2.internal\" DevicePath \"\"" May 21 11:58:39.609259 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.609228 2565 generic.go:358] "Generic (PLEG): container finished" podID="ba5b019f-db11-492f-ad4d-d9221f86449d" containerID="c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790" exitCode=0 May 21 11:58:39.609456 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.609318 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" May 21 11:58:39.609456 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.609314 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" event={"ID":"ba5b019f-db11-492f-ad4d-d9221f86449d","Type":"ContainerDied","Data":"c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790"} May 21 11:58:39.609456 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.609368 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698fdfdc7b-wnts2" event={"ID":"ba5b019f-db11-492f-ad4d-d9221f86449d","Type":"ContainerDied","Data":"0152ac955b1944bc9e85b1dd058fa260ae6dbba815bb2111ac0facfa820268ef"} May 21 11:58:39.609456 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.609389 2565 scope.go:117] "RemoveContainer" containerID="c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790" May 21 11:58:39.618300 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.618079 2565 scope.go:117] "RemoveContainer" containerID="c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790" May 21 11:58:39.618526 ip-10-0-129-255 kubenswrapper[2565]: E0521 11:58:39.618362 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790\": container with ID starting with c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790 not found: ID does not exist" containerID="c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790" May 21 11:58:39.618526 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.618386 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790"} err="failed to get container status \"c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790\": rpc error: code = NotFound desc = could not find container \"c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790\": container with ID starting with c090f4f83475f871a6fef33ef74d2ce51353e51ff346fb1d9b85e840808e8790 not found: ID does not exist" May 21 11:58:39.626370 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.626339 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-698fdfdc7b-wnts2"] May 21 11:58:39.629545 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:39.629525 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-698fdfdc7b-wnts2"] May 21 11:58:41.161714 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:41.161683 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba5b019f-db11-492f-ad4d-d9221f86449d" path="/var/lib/kubelet/pods/ba5b019f-db11-492f-ad4d-d9221f86449d/volumes" May 21 11:58:47.098176 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:47.098146 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:58:47.098621 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:47.098247 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 11:58:47.102837 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:47.102812 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 11:58:47.103120 ip-10-0-129-255 kubenswrapper[2565]: I0521 11:58:47.103102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6mf9_ae9abcf2-9e8b-4104-aace-509e4aeed93b/ovn-acl-logging/0.log" May 21 12:01:47.205588 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:47.205511 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-5xt7d_abd193d7-1f7c-45e8-a5fa-7b624f473a0c/manager/0.log" May 21 12:01:47.323095 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:47.323062 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-844b96754f-5pkm9_9c2d44ed-230a-42bd-a76c-ed1e78bb9447/maas-api/0.log" May 21 12:01:47.701209 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:47.701170 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-qsdxh_87f3dc02-dcf0-470e-a2e5-40f261d0af81/manager/2.log" May 21 12:01:48.086681 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:48.086644 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f899c7c-ltf65_378c1eb8-b502-45ea-b5b3-3b4ad72346de/manager/0.log" May 21 12:01:48.203786 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:48.203755 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-769jl_17b69086-708f-4987-bdfa-c9ab093e5a4a/postgres/0.log" May 21 12:01:48.973679 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:48.973644 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm_6c509604-719b-4765-bd4e-8020d0ffbe94/util/0.log" May 21 12:01:48.981979 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:48.981944 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm_6c509604-719b-4765-bd4e-8020d0ffbe94/pull/0.log" May 21 12:01:48.995855 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:48.995824 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm_6c509604-719b-4765-bd4e-8020d0ffbe94/extract/0.log" May 21 12:01:49.106108 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.106072 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw_3a171886-10a9-4896-82d4-fd652b22f915/pull/0.log" May 21 12:01:49.114244 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.114217 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw_3a171886-10a9-4896-82d4-fd652b22f915/extract/0.log" May 21 12:01:49.122379 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.122350 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw_3a171886-10a9-4896-82d4-fd652b22f915/util/0.log" May 21 12:01:49.232648 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.232565 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69_60bea636-7f60-4af2-bbf6-6211ce84c6da/util/0.log" May 21 12:01:49.240656 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.240632 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69_60bea636-7f60-4af2-bbf6-6211ce84c6da/pull/0.log" May 21 12:01:49.251485 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.251460 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69_60bea636-7f60-4af2-bbf6-6211ce84c6da/extract/0.log" May 21 12:01:49.370365 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.370331 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt_77ad1361-4eaf-4a81-9eed-4bef1e245a29/util/0.log" May 21 12:01:49.378882 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.378850 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt_77ad1361-4eaf-4a81-9eed-4bef1e245a29/pull/0.log" May 21 12:01:49.386947 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.386916 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt_77ad1361-4eaf-4a81-9eed-4bef1e245a29/extract/0.log" May 21 12:01:49.643259 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:49.643216 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8667x_a31d24e6-c1f3-4645-a279-912e756afdb1/manager/0.log" May 21 12:01:50.819732 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:50.819707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-vxvf2_1681c9d0-51b2-4f9a-8212-6d7d5bdee228/discovery/0.log" May 21 12:01:51.045659 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:51.045630 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff9d596fb-fvhw7_6f4b44d4-3bcd-4042-940e-7980e80fb285/kube-auth-proxy/0.log" May 21 12:01:51.294033 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:51.293953 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-9d6tz_abdf72ef-d972-4630-afce-31e9b1b3a90b/payload-processing/0.log" May 21 12:01:51.407136 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:51.407093 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b9954fc88-snzzt_a1b1c897-e8dc-4169-bd9d-0836b132e180/router/0.log" May 21 12:01:51.992945 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:51.992914 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-jpvdc_fc19fea5-185e-40a0-a486-564ba8bb8009/storage-initializer/0.log" May 21 12:01:52.001962 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:52.001935 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-jpvdc_fc19fea5-185e-40a0-a486-564ba8bb8009/main/0.log" May 21 12:01:52.128717 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:52.128689 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb_54a59ac9-8545-412f-a14c-b892da3b589c/storage-initializer/0.log" May 21 12:01:52.141935 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:52.141902 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc2s8vb_54a59ac9-8545-412f-a14c-b892da3b589c/main/0.log" May 21 12:01:52.385876 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:52.385846 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz_4f9e6486-4260-4d8a-a42b-bcce4669654e/storage-initializer/0.log" May 21 12:01:52.396530 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:52.396499 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-b9qlz_4f9e6486-4260-4d8a-a42b-bcce4669654e/main/0.log" May 21 12:01:59.921917 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:01:59.921885 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n62nl_b458a50b-76f7-4a45-878d-3d4d08769841/global-pull-secret-syncer/0.log" May 21 12:02:00.006733 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:00.006703 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bf8nd_00dbc12c-57b3-4249-b56f-6290e1cea32b/konnectivity-agent/0.log" May 21 12:02:00.089861 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:00.089826 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-255.ec2.internal_7b3377fb9a8b818b500586a2752a7122/haproxy/0.log" May 21 12:02:04.085101 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.085055 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm_6c509604-719b-4765-bd4e-8020d0ffbe94/extract/0.log" May 21 12:02:04.112284 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.112232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm_6c509604-719b-4765-bd4e-8020d0ffbe94/util/0.log" May 21 12:02:04.138714 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.138687 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b27hm_6c509604-719b-4765-bd4e-8020d0ffbe94/pull/0.log" May 21 12:02:04.170107 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.170078 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw_3a171886-10a9-4896-82d4-fd652b22f915/extract/0.log" May 21 12:02:04.194088 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.194056 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw_3a171886-10a9-4896-82d4-fd652b22f915/util/0.log" May 21 12:02:04.218629 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.218602 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jxdvw_3a171886-10a9-4896-82d4-fd652b22f915/pull/0.log" May 21 12:02:04.252431 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.252397 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69_60bea636-7f60-4af2-bbf6-6211ce84c6da/extract/0.log" May 21 12:02:04.291989 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.291957 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69_60bea636-7f60-4af2-bbf6-6211ce84c6da/util/0.log" May 21 12:02:04.332792 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.332758 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7354d69_60bea636-7f60-4af2-bbf6-6211ce84c6da/pull/0.log" May 21 12:02:04.384984 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.384899 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt_77ad1361-4eaf-4a81-9eed-4bef1e245a29/extract/0.log" May 21 12:02:04.424877 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.424840 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt_77ad1361-4eaf-4a81-9eed-4bef1e245a29/util/0.log" May 21 12:02:04.467843 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.467813 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fnsqt_77ad1361-4eaf-4a81-9eed-4bef1e245a29/pull/0.log" May 21 12:02:04.598402 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:04.598362 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8667x_a31d24e6-c1f3-4645-a279-912e756afdb1/manager/0.log" May 21 12:02:06.316448 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.316422 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c715913f-0913-43b6-adde-ddec7d1130f6/alertmanager/0.log" May 21 12:02:06.360485 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.360459 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c715913f-0913-43b6-adde-ddec7d1130f6/config-reloader/0.log" May 21 12:02:06.396171 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.396141 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c715913f-0913-43b6-adde-ddec7d1130f6/kube-rbac-proxy-web/0.log" May 21 12:02:06.427175 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.427149 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c715913f-0913-43b6-adde-ddec7d1130f6/kube-rbac-proxy/0.log" May 21 12:02:06.458632 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.458598 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c715913f-0913-43b6-adde-ddec7d1130f6/kube-rbac-proxy-metric/0.log" May 21 12:02:06.481718 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.481690 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c715913f-0913-43b6-adde-ddec7d1130f6/prom-label-proxy/0.log" May 21 12:02:06.506144 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.506116 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c715913f-0913-43b6-adde-ddec7d1130f6/init-config-reloader/0.log" May 21 12:02:06.554925 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.554890 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-h5bz2_1e1616ab-073c-4af0-8061-d796e3afe02d/cluster-monitoring-operator/0.log" May 21 12:02:06.671966 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.671885 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-759766f98-2tgn9_93bfd407-aaad-452e-84b6-6890cb484a33/metrics-server/0.log" May 21 12:02:06.878197 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.878169 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lwpqd_ee560e03-fd64-40af-b623-495f9d0994c6/node-exporter/0.log" May 21 12:02:06.929133 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.929045 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lwpqd_ee560e03-fd64-40af-b623-495f9d0994c6/kube-rbac-proxy/0.log" May 21 12:02:06.985528 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:06.985503 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lwpqd_ee560e03-fd64-40af-b623-495f9d0994c6/init-textfile/0.log" May 21 12:02:07.580654 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:07.580625 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gnwf4_86672746-1cf7-4504-9a35-4044d21a9972/prometheus-operator/0.log" May 21 12:02:07.609353 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:07.609316 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gnwf4_86672746-1cf7-4504-9a35-4044d21a9972/kube-rbac-proxy/0.log" May 21 12:02:07.637325 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:07.637298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-4gw27_eb9288cc-358e-47e2-9e83-c1d1005cbed4/prometheus-operator-admission-webhook/0.log" May 21 12:02:07.665734 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:07.665696 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-658f8c5fc9-mn6xr_c7e33e12-6e87-4564-b3c4-f03c15e04fbc/telemeter-client/0.log" May 21 12:02:07.692875 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:07.692833 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-658f8c5fc9-mn6xr_c7e33e12-6e87-4564-b3c4-f03c15e04fbc/reload/0.log" May 21 12:02:07.722267 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:07.722232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-658f8c5fc9-mn6xr_c7e33e12-6e87-4564-b3c4-f03c15e04fbc/kube-rbac-proxy/0.log" May 21 12:02:08.099149 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.099116 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj"] May 21 12:02:08.099603 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.099589 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba5b019f-db11-492f-ad4d-d9221f86449d" containerName="manager" May 21 12:02:08.099652 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.099606 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba5b019f-db11-492f-ad4d-d9221f86449d" containerName="manager" May 21 12:02:08.099693 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.099688 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba5b019f-db11-492f-ad4d-d9221f86449d" containerName="manager" May 21 12:02:08.103193 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.103176 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.107143 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.107121 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nkblz\"/\"default-dockercfg-xvgsm\"" May 21 12:02:08.108679 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.108650 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nkblz\"/\"kube-root-ca.crt\"" May 21 12:02:08.108847 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.108825 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nkblz\"/\"openshift-service-ca.crt\"" May 21 12:02:08.127426 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.127383 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj"] May 21 12:02:08.215865 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.215804 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-sys\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.215865 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.215880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-lib-modules\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.216151 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.215947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-proc\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.216151 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.215982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-podres\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.216151 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.216007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfj8c\" (UniqueName: \"kubernetes.io/projected/a2a6bd81-9a82-4407-967b-dabcd27c3cea-kube-api-access-gfj8c\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317348 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317303 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-lib-modules\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317570 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317403 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-proc\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317570 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317439 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-podres\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317570 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317514 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-lib-modules\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317570 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317537 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-podres\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317570 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-proc\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317824 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317580 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfj8c\" (UniqueName: \"kubernetes.io/projected/a2a6bd81-9a82-4407-967b-dabcd27c3cea-kube-api-access-gfj8c\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317824 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317678 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-sys\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.317824 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.317778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a6bd81-9a82-4407-967b-dabcd27c3cea-sys\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.331180 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.331152 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfj8c\" (UniqueName: \"kubernetes.io/projected/a2a6bd81-9a82-4407-967b-dabcd27c3cea-kube-api-access-gfj8c\") pod \"perf-node-gather-daemonset-mv8kj\" (UID: \"a2a6bd81-9a82-4407-967b-dabcd27c3cea\") " pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.414669 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.414570 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:08.591527 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.591500 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj"] May 21 12:02:08.592929 ip-10-0-129-255 kubenswrapper[2565]: W0521 12:02:08.592897 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2a6bd81_9a82_4407_967b_dabcd27c3cea.slice/crio-43a6f5bf9b8c5f58d644d0a71e0aac1c4f7ef7760b6ed1f787f1c4ce1ec49f2b WatchSource:0}: Error finding container 43a6f5bf9b8c5f58d644d0a71e0aac1c4f7ef7760b6ed1f787f1c4ce1ec49f2b: Status 404 returned error can't find the container with id 43a6f5bf9b8c5f58d644d0a71e0aac1c4f7ef7760b6ed1f787f1c4ce1ec49f2b May 21 12:02:08.594689 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:08.594671 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 12:02:09.479493 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:09.479452 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/2.log" May 21 12:02:09.487235 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:09.487206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lzhv_3df687e9-f288-4f8c-97a5-2e28ef81dd6f/console-operator/3.log" May 21 12:02:09.490000 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:09.489963 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" event={"ID":"a2a6bd81-9a82-4407-967b-dabcd27c3cea","Type":"ContainerStarted","Data":"c4f38b27d13a9fb9ffefac3e3fd684a53e01d0974333abb2d943d780bee16a72"} May 21 12:02:09.490000 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:09.489999 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" event={"ID":"a2a6bd81-9a82-4407-967b-dabcd27c3cea","Type":"ContainerStarted","Data":"43a6f5bf9b8c5f58d644d0a71e0aac1c4f7ef7760b6ed1f787f1c4ce1ec49f2b"} May 21 12:02:09.490212 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:09.490023 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:09.518948 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:09.518896 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" podStartSLOduration=1.518881043 podStartE2EDuration="1.518881043s" podCreationTimestamp="2026-05-21 12:02:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:02:09.515132332 +0000 UTC m=+1102.944063199" watchObservedRunningTime="2026-05-21 12:02:09.518881043 +0000 UTC m=+1102.947811910" May 21 12:02:09.966488 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:09.966461 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d968d8f8f-dmc9w_c9c6e915-3882-4064-8890-3de59c030ce9/console/0.log" May 21 12:02:09.998893 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:09.998858 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-wz99x_da248605-9c7a-4ff6-ba03-d2ff928d9bfa/download-server/0.log" May 21 12:02:10.577042 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:10.577012 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-q9js4_625425a2-0237-473a-9a52-d238c29f9335/volume-data-source-validator/0.log" May 21 12:02:11.452592 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:11.452561 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5kkp2_7fa9ae98-31db-45b3-9c64-90f571f92e8b/dns/0.log" May 21 12:02:11.484653 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:11.484623 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5kkp2_7fa9ae98-31db-45b3-9c64-90f571f92e8b/kube-rbac-proxy/0.log" May 21 12:02:11.638624 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:11.638587 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fs9s4_5dfd9d49-f61c-4c0f-93bd-ae95abebb036/dns-node-resolver/0.log" May 21 12:02:12.215427 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:12.215390 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8476f4fcc8-75q4s_1283ace3-87c1-4dd1-9455-21a9f02ff307/registry/0.log" May 21 12:02:12.238797 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:12.238764 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cxw7j_b2eec013-9617-40a4-ac11-5e4eb5f17c0f/node-ca/0.log" May 21 12:02:13.289148 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:13.289103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-vxvf2_1681c9d0-51b2-4f9a-8212-6d7d5bdee228/discovery/0.log" May 21 12:02:13.337850 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:13.337815 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ff9d596fb-fvhw7_6f4b44d4-3bcd-4042-940e-7980e80fb285/kube-auth-proxy/0.log" May 21 12:02:13.417605 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:13.417568 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-9d6tz_abdf72ef-d972-4630-afce-31e9b1b3a90b/payload-processing/0.log" May 21 12:02:13.444488 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:13.444454 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b9954fc88-snzzt_a1b1c897-e8dc-4169-bd9d-0836b132e180/router/0.log" May 21 12:02:14.019685 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:14.019657 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vc87h_fe84da0a-c03f-4d28-9d56-fdd9844b31bf/serve-healthcheck-canary/0.log" May 21 12:02:14.436372 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:14.436296 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-zg9v2_2dae388d-4cf0-4fd4-868f-f8890245f60f/insights-operator/1.log" May 21 12:02:14.446339 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:14.446310 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-zg9v2_2dae388d-4cf0-4fd4-868f-f8890245f60f/insights-operator/0.log" May 21 12:02:14.645620 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:14.645591 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8dbq_610df456-885d-427f-a743-163322e504f2/kube-rbac-proxy/0.log" May 21 12:02:14.671179 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:14.671151 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8dbq_610df456-885d-427f-a743-163322e504f2/exporter/0.log" May 21 12:02:14.694718 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:14.694646 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8dbq_610df456-885d-427f-a743-163322e504f2/extractor/0.log" May 21 12:02:15.504706 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:15.504671 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nkblz/perf-node-gather-daemonset-mv8kj" May 21 12:02:16.733821 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:16.733795 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-5xt7d_abd193d7-1f7c-45e8-a5fa-7b624f473a0c/manager/0.log" May 21 12:02:16.770663 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:16.770581 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-844b96754f-5pkm9_9c2d44ed-230a-42bd-a76c-ed1e78bb9447/maas-api/0.log" May 21 12:02:16.858651 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:16.858622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-qsdxh_87f3dc02-dcf0-470e-a2e5-40f261d0af81/manager/1.log" May 21 12:02:16.878750 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:16.878718 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-qsdxh_87f3dc02-dcf0-470e-a2e5-40f261d0af81/manager/2.log" May 21 12:02:17.064711 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:17.064676 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f899c7c-ltf65_378c1eb8-b502-45ea-b5b3-3b4ad72346de/manager/0.log" May 21 12:02:17.089841 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:17.089813 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-769jl_17b69086-708f-4987-bdfa-c9ab093e5a4a/postgres/0.log" May 21 12:02:18.440763 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:18.440730 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-752rb_2e30d937-cef6-4a82-8b3f-f5e9b41c83f2/openshift-lws-operator/0.log" May 21 12:02:24.568898 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:24.568865 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lc944_5026e325-ff9f-4f0f-b706-8e97367bb7db/kube-multus-additional-cni-plugins/0.log" May 21 12:02:24.599720 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:24.599690 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lc944_5026e325-ff9f-4f0f-b706-8e97367bb7db/egress-router-binary-copy/0.log" May 21 12:02:24.642209 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:24.642175 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lc944_5026e325-ff9f-4f0f-b706-8e97367bb7db/cni-plugins/0.log" May 21 12:02:24.694196 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:24.694165 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lc944_5026e325-ff9f-4f0f-b706-8e97367bb7db/bond-cni-plugin/0.log" May 21 12:02:24.742250 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:24.742222 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lc944_5026e325-ff9f-4f0f-b706-8e97367bb7db/routeoverride-cni/0.log" May 21 12:02:24.795427 ip-10-0-129-255 kubenswrapper[2565]: I0521 12:02:24.795402 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lc944_5026e325-ff9f-4f0f-b706-8e97367bb7db/whereabouts-cni-bincopy/0.log"