May 31 17:20:31.303186 ip-10-0-142-63 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 31 17:20:31.303194 ip-10-0-142-63 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 31 17:20:31.303201 ip-10-0-142-63 systemd[1]: kubelet.service: Failed with result 'resources'. May 31 17:20:31.303413 ip-10-0-142-63 systemd[1]: Failed to start Kubernetes Kubelet. May 31 17:20:41.329442 ip-10-0-142-63 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 31 17:20:41.329459 ip-10-0-142-63 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 61cb367819c844e5b0832b9eb3db144c -- May 31 17:23:11.019850 ip-10-0-142-63 systemd[1]: Starting Kubernetes Kubelet... May 31 17:23:11.526113 ip-10-0-142-63 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 31 17:23:11.526113 ip-10-0-142-63 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 31 17:23:11.526113 ip-10-0-142-63 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 31 17:23:11.526113 ip-10-0-142-63 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 31 17:23:11.526113 ip-10-0-142-63 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 31 17:23:11.527204 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.527114 2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 31 17:23:11.531146 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531130 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:11.531146 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531147 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531150 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531154 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531157 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531160 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531163 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531166 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531170 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531173 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531175 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531178 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531181 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531184 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531193 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531196 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531199 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531202 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531204 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531207 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531209 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:11.531215 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531212 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531215 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531217 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531220 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531223 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531226 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531229 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531232 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531234 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531237 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531239 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531242 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531244 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531247 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531249 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531252 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531254 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531257 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531259 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:11.531742 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531262 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531265 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531267 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531269 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531272 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531274 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531277 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531279 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531281 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531284 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531286 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531289 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531291 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531293 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531297 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531303 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531307 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531310 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531313 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531316 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:11.532194 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531318 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531321 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531324 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531326 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531329 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531331 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531334 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531337 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531339 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531342 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531344 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531347 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531350 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531353 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531355 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531358 2569 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531360 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531365 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531368 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531371 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:11.532793 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531374 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531376 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531379 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531381 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531384 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531386 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531803 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531811 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531815 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531817 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531820 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531823 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531826 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531829 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531832 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531834 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531837 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531840 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531842 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531845 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:11.533270 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531848 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531850 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531853 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531855 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531859 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531861 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531864 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531866 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531869 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531871 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531874 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531876 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531879 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531882 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531884 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531887 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531889 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531892 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531894 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:11.533773 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531897 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531900 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531903 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531906 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531908 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531911 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531913 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531917 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531921 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531924 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531927 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531929 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531932 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531934 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531937 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531939 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531942 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531945 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531948 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:11.534268 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531950 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531953 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531955 2569 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531957 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531961 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531965 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531967 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531970 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531973 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531975 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531978 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531980 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531983 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531986 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531989 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531991 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531994 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531996 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.531999 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:11.534744 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532001 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532004 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532007 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532010 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532012 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532015 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532017 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532020 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532022 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532025 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532028 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532030 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532033 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532036 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.532039 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533404 2569 flags.go:64] FLAG: --address="0.0.0.0" May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533415 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533422 2569 flags.go:64] FLAG: --anonymous-auth="true" May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533427 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533431 2569 flags.go:64] FLAG: --authentication-token-webhook="false" May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533435 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 31 17:23:11.535198 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533439 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533444 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533447 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533450 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533454 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533461 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533465 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533468 2569 flags.go:64] FLAG: --cgroup-root="" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533471 2569 flags.go:64] FLAG: --cgroups-per-qos="true" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533474 2569 flags.go:64] FLAG: --client-ca-file="" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533477 2569 flags.go:64] FLAG: --cloud-config="" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533480 2569 flags.go:64] FLAG: --cloud-provider="external" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533483 2569 flags.go:64] FLAG: --cluster-dns="[]" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533500 2569 flags.go:64] FLAG: --cluster-domain="" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533503 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533506 2569 flags.go:64] FLAG: --config-dir="" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533509 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533513 2569 flags.go:64] FLAG: --container-log-max-files="5" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533517 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533521 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533524 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533527 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533530 2569 flags.go:64] FLAG: --contention-profiling="false" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533533 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" May 31 17:23:11.535727 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533536 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533540 2569 flags.go:64] FLAG: --cpu-manager-policy="none" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533544 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533548 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533551 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533554 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533557 2569 flags.go:64] FLAG: --enable-load-reader="false" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533560 2569 flags.go:64] FLAG: --enable-server="true" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533563 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533567 2569 flags.go:64] FLAG: --event-burst="100" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533570 2569 flags.go:64] FLAG: --event-qps="50" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533573 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533577 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533582 2569 flags.go:64] FLAG: --eviction-hard="" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533586 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533588 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533592 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533595 2569 flags.go:64] FLAG: --eviction-soft="" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533598 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533600 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533603 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533606 2569 flags.go:64] FLAG: --experimental-mounter-path="" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533609 2569 flags.go:64] FLAG: --fail-cgroupv1="false" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533612 2569 flags.go:64] FLAG: --fail-swap-on="true" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533615 2569 flags.go:64] FLAG: --feature-gates="" May 31 17:23:11.536296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533618 2569 flags.go:64] FLAG: --file-check-frequency="20s" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533622 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533625 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533628 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533631 2569 flags.go:64] FLAG: --healthz-port="10248" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533634 2569 flags.go:64] FLAG: --help="false" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533637 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-142-63.ec2.internal" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533640 2569 flags.go:64] FLAG: --housekeeping-interval="10s" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533643 2569 flags.go:64] FLAG: --http-check-frequency="20s" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533647 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533650 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533661 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533665 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533668 2569 flags.go:64] FLAG: --image-service-endpoint="" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533671 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533674 2569 flags.go:64] FLAG: --kube-api-burst="100" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533677 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533680 2569 flags.go:64] FLAG: --kube-api-qps="50" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533682 2569 flags.go:64] FLAG: --kube-reserved="" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533685 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533691 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533694 2569 flags.go:64] FLAG: --kubelet-cgroups="" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533697 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533700 2569 flags.go:64] FLAG: --lock-file="" May 31 17:23:11.536916 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533703 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533706 2569 flags.go:64] FLAG: --log-flush-frequency="5s" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533709 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533715 2569 flags.go:64] FLAG: --log-json-split-stream="false" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533718 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533721 2569 flags.go:64] FLAG: --log-text-split-stream="false" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533723 2569 flags.go:64] FLAG: --logging-format="text" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533726 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533730 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533733 2569 flags.go:64] FLAG: --manifest-url="" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533736 2569 flags.go:64] FLAG: --manifest-url-header="" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533740 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533744 2569 flags.go:64] FLAG: --max-open-files="1000000" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533748 2569 flags.go:64] FLAG: --max-pods="110" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533751 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533754 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533757 2569 flags.go:64] FLAG: --memory-manager-policy="None" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533760 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533771 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533774 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533777 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533790 2569 flags.go:64] FLAG: --node-status-max-images="50" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533793 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533796 2569 flags.go:64] FLAG: --oom-score-adj="-999" May 31 17:23:11.537516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533799 2569 flags.go:64] FLAG: --pod-cidr="" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533802 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533807 2569 flags.go:64] FLAG: --pod-manifest-path="" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533810 2569 flags.go:64] FLAG: --pod-max-pids="-1" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533815 2569 flags.go:64] FLAG: --pods-per-core="0" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533819 2569 flags.go:64] FLAG: --port="10250" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533822 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533825 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082d7ea266c1036b0" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533828 2569 flags.go:64] FLAG: --qos-reserved="" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533831 2569 flags.go:64] FLAG: --read-only-port="10255" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533834 2569 flags.go:64] FLAG: --register-node="true" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533837 2569 flags.go:64] FLAG: --register-schedulable="true" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533840 2569 flags.go:64] FLAG: --register-with-taints="" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533847 2569 flags.go:64] FLAG: --registry-burst="10" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533850 2569 flags.go:64] FLAG: --registry-qps="5" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533853 2569 flags.go:64] FLAG: --reserved-cpus="" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533855 2569 flags.go:64] FLAG: --reserved-memory="" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533859 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533862 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533865 2569 flags.go:64] FLAG: --rotate-certificates="false" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533868 2569 flags.go:64] FLAG: --rotate-server-certificates="false" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533871 2569 flags.go:64] FLAG: --runonce="false" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533873 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533876 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533879 2569 flags.go:64] FLAG: --seccomp-default="false" May 31 17:23:11.538096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533882 2569 flags.go:64] FLAG: --serialize-image-pulls="true" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533885 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533889 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533892 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533895 2569 flags.go:64] FLAG: --storage-driver-password="root" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533897 2569 flags.go:64] FLAG: --storage-driver-secure="false" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533900 2569 flags.go:64] FLAG: --storage-driver-table="stats" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533903 2569 flags.go:64] FLAG: --storage-driver-user="root" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533906 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533909 2569 flags.go:64] FLAG: --sync-frequency="1m0s" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533911 2569 flags.go:64] FLAG: --system-cgroups="" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533917 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533923 2569 flags.go:64] FLAG: --system-reserved-cgroup="" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533927 2569 flags.go:64] FLAG: --tls-cert-file="" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533930 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533937 2569 flags.go:64] FLAG: --tls-min-version="" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533940 2569 flags.go:64] FLAG: --tls-private-key-file="" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533942 2569 flags.go:64] FLAG: --topology-manager-policy="none" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533945 2569 flags.go:64] FLAG: --topology-manager-policy-options="" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533948 2569 flags.go:64] FLAG: --topology-manager-scope="container" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533951 2569 flags.go:64] FLAG: --v="2" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533956 2569 flags.go:64] FLAG: --version="false" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533960 2569 flags.go:64] FLAG: --vmodule="" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533965 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.533968 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 31 17:23:11.538712 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534067 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534071 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534074 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534077 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534080 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534082 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534085 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534088 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534090 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534092 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534096 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534099 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534101 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534104 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534106 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534109 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534113 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534116 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534120 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:11.539292 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534123 2569 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534126 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534129 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534132 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534134 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534137 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534139 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534142 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534144 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534147 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534149 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534152 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534154 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534157 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534159 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534162 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534164 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534167 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534169 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534171 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:11.539812 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534174 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534176 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534179 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534181 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534184 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534187 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534189 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534192 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534195 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534197 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534200 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534204 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534207 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534209 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534212 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534214 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534217 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534219 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534221 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:11.540300 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534224 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534227 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534229 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534232 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534235 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534239 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534241 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534244 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534246 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534249 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534251 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534253 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534256 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534258 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534261 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534263 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534266 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534268 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534271 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534274 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:11.540876 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534276 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:11.541368 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534279 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:11.541368 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534282 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:11.541368 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534284 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:11.541368 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534288 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:11.541368 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534291 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:11.541368 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534294 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:11.541368 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.534297 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:11.541368 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.535218 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 31 17:23:11.543035 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.543017 2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" May 31 17:23:11.543075 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.543037 2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 31 17:23:11.543106 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543085 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:11.543106 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543090 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:11.543106 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543094 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:11.543106 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543097 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:11.543106 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543100 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:11.543106 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543103 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:11.543106 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543106 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:11.543106 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543109 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543112 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543115 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543118 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543120 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543124 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543129 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543132 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543136 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543138 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543141 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543144 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543146 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543149 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543152 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543154 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543157 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543161 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543165 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:11.543305 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543168 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543171 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543174 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543177 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543180 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543183 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543186 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543189 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543192 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543195 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543197 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543200 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543202 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543205 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543207 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543211 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543213 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543216 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543219 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543221 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:11.543799 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543224 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543227 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543229 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543232 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543235 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543237 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543240 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543242 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543245 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543247 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543250 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543252 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543255 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543257 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543260 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543262 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543264 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543267 2569 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543271 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543273 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:11.544272 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543276 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543278 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543281 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543283 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543286 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543289 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543291 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543295 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543297 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543300 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543303 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543305 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543308 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543311 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543313 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543316 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543319 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543322 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543325 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:11.544858 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543328 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.543333 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543437 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543442 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543445 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543448 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543451 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543454 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543457 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543460 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543463 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543466 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543469 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543472 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543475 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:11.545311 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543478 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543480 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543483 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543485 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543501 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543504 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543507 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543510 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543513 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543515 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543518 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543521 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543523 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543526 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543529 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543532 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543534 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543536 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543541 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543544 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:11.545697 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543547 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543550 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543553 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543555 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543558 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543561 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543563 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543566 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543568 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543571 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543575 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543578 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543581 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543583 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543586 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543588 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543591 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543593 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543596 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543599 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:11.546179 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543602 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543604 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543607 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543609 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543611 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543614 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543617 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543619 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543622 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543624 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543627 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543629 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543631 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543634 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543636 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543639 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543642 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543644 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543646 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543649 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:11.546663 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543652 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543656 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543659 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543662 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543665 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543668 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543671 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543673 2569 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543676 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543678 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543681 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543684 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:11.543686 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.543691 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.543810 2569 server.go:962] "Client rotation is on, will bootstrap in background" May 31 17:23:11.547161 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.546996 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 31 17:23:11.548077 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.548065 2569 server.go:1019] "Starting client certificate rotation" May 31 17:23:11.548186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.548167 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 31 17:23:11.548237 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.548225 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 31 17:23:11.577799 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.577767 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 31 17:23:11.580721 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.580697 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 31 17:23:11.600479 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.600450 2569 log.go:25] "Validated CRI v1 runtime API" May 31 17:23:11.607432 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.607414 2569 log.go:25] "Validated CRI v1 image API" May 31 17:23:11.609224 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.609202 2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 31 17:23:11.611600 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.611571 2569 fs.go:135] Filesystem UUIDs: map[058cd067-97c1-4e25-a55b-9b6b25db060d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bee05ae5-219f-4140-a326-21cc62755a1a:/dev/nvme0n1p4] May 31 17:23:11.611653 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.611600 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 31 17:23:11.616110 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.615990 2569 manager.go:217] Machine: {Timestamp:2026-05-31 17:23:11.615422998 +0000 UTC m=+0.460050003 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095736 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21bef5b6a3f5249dc8cec56644a8b5 SystemUUID:ec21bef5-b6a3-f524-9dc8-cec56644a8b5 BootID:61cb3678-19c8-44e5-b083-2b9eb3db144c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:79:5c:87:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:79:5c:87:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f5:10:6e:14:8c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 31 17:23:11.616110 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.616095 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 31 17:23:11.616243 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.616182 2569 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 31 17:23:11.619600 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.619248 2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 31 17:23:11.619682 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.619583 2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 31 17:23:11.619764 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.619606 2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 31 17:23:11.619808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.619778 2569 topology_manager.go:138] "Creating topology manager with none policy" May 31 17:23:11.619808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.619791 2569 container_manager_linux.go:306] "Creating device plugin manager" May 31 17:23:11.619808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.619800 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 31 17:23:11.619884 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.619816 2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 31 17:23:11.621770 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.621758 2569 state_mem.go:36] "Initialized new in-memory state store" May 31 17:23:11.622079 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.622068 2569 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 31 17:23:11.624844 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.624831 2569 kubelet.go:491] "Attempting to sync node with API server" May 31 17:23:11.624882 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.624848 2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 31 17:23:11.624882 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.624861 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 31 17:23:11.624882 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.624873 2569 kubelet.go:397] "Adding apiserver pod source" May 31 17:23:11.624882 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.624882 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 31 17:23:11.626151 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.626136 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 31 17:23:11.626206 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.626166 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 31 17:23:11.629873 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.629855 2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" May 31 17:23:11.632423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.632407 2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 31 17:23:11.635507 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635481 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 31 17:23:11.635554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635514 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 31 17:23:11.635554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635521 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 31 17:23:11.635554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635527 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 31 17:23:11.635554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635535 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 31 17:23:11.635554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635541 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 31 17:23:11.635554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635547 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 31 17:23:11.635554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635552 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 31 17:23:11.635734 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635559 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 31 17:23:11.635734 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635565 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 31 17:23:11.635734 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635573 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 31 17:23:11.635734 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.635579 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 31 17:23:11.636672 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.636663 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 31 17:23:11.636672 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.636672 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 31 17:23:11.640277 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.640259 2569 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 31 17:23:11.640408 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.640305 2569 server.go:1295] "Started kubelet" May 31 17:23:11.640408 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.640363 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 31 17:23:11.640518 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.640451 2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 31 17:23:11.640550 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.640542 2569 server_v1.go:47] "podresources" method="list" useActivePods=true May 31 17:23:11.641123 ip-10-0-142-63 systemd[1]: Started Kubernetes Kubelet. May 31 17:23:11.642068 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.641949 2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 31 17:23:11.645794 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.644861 2569 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 31 17:23:11.646318 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.646300 2569 server.go:317] "Adding debug handlers to kubelet server" May 31 17:23:11.651252 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.651223 2569 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 31 17:23:11.651660 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.651633 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 31 17:23:11.652326 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.652301 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 31 17:23:11.652426 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.652406 2569 volume_manager.go:295] "The desired_state_of_world populator starts" May 31 17:23:11.652426 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.652424 2569 volume_manager.go:297] "Starting Kubelet Volume Manager" May 31 17:23:11.652575 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.652547 2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 31 17:23:11.652631 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.652614 2569 reconstruct.go:97] "Volume reconstruction finished" May 31 17:23:11.652631 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.652622 2569 reconciler.go:26] "Reconciler: start to sync state" May 31 17:23:11.653300 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.653282 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:11.653717 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.653702 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 31 17:23:11.653717 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.653719 2569 factory.go:55] Registering systemd factory May 31 17:23:11.653839 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.653728 2569 factory.go:223] Registration of the systemd container factory successfully May 31 17:23:11.653976 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.653965 2569 factory.go:153] Registering CRI-O factory May 31 17:23:11.654030 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.653979 2569 factory.go:223] Registration of the crio container factory successfully May 31 17:23:11.654030 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.653996 2569 factory.go:103] Registering Raw factory May 31 17:23:11.654030 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.654009 2569 manager.go:1196] Started watching for new ooms in manager May 31 17:23:11.654331 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.654318 2569 manager.go:319] Starting recovery of all containers May 31 17:23:11.658224 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.658170 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 31 17:23:11.658996 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.658965 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 31 17:23:11.659096 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.659038 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 31 17:23:11.659843 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.658473 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18b4b64c52c00946 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-05-31 17:23:11.64027527 +0000 UTC m=+0.484902275,LastTimestamp:2026-05-31 17:23:11.64027527 +0000 UTC m=+0.484902275,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}" May 31 17:23:11.659843 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.659727 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 31 17:23:11.664122 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.664106 2569 manager.go:324] Recovery completed May 31 17:23:11.668322 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.668306 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.670575 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.670546 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.670657 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.670584 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.670657 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.670596 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.671144 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.671129 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" May 31 17:23:11.671144 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.671140 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 31 17:23:11.671239 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.671155 2569 state_mem.go:36] "Initialized new in-memory state store" May 31 17:23:11.673318 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.673253 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18b4b64c548e4537 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-05-31 17:23:11.670568247 +0000 UTC m=+0.515195252,LastTimestamp:2026-05-31 17:23:11.670568247 +0000 UTC m=+0.515195252,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}" May 31 17:23:11.674958 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.674941 2569 policy_none.go:49] "None policy: Start" May 31 17:23:11.675022 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.674966 2569 memory_manager.go:186] "Starting memorymanager" policy="None" May 31 17:23:11.675022 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.674981 2569 state_mem.go:35] "Initializing new in-memory state store" May 31 17:23:11.684432 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.684365 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18b4b64c548e96e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-05-31 17:23:11.670589161 +0000 UTC m=+0.515216167,LastTimestamp:2026-05-31 17:23:11.670589161 +0000 UTC m=+0.515216167,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}" May 31 17:23:11.698689 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.698611 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18b4b64c548ec762 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-05-31 17:23:11.67060157 +0000 UTC m=+0.515228582,LastTimestamp:2026-05-31 17:23:11.67060157 +0000 UTC m=+0.515228582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}" May 31 17:23:11.711667 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.711642 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p99hr" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.716105 2569 manager.go:341] "Starting Device Plugin manager" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.716146 2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.716161 2569 server.go:85] "Starting device plugin registration server" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.716449 2569 eviction_manager.go:189] "Eviction manager: starting control loop" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.716462 2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.716609 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.716683 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.716692 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.717243 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.717281 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.728412 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p99hr" May 31 17:23:11.735743 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.731065 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18b4b64c57685b38 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-05-31 17:23:11.71841516 +0000 UTC m=+0.563042169,LastTimestamp:2026-05-31 17:23:11.71841516 +0000 UTC m=+0.563042169,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}" May 31 17:23:11.750653 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.750578 2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 31 17:23:11.751995 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.751967 2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 31 17:23:11.751995 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.751993 2569 status_manager.go:230] "Starting to sync pod status with apiserver" May 31 17:23:11.752172 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.752014 2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 31 17:23:11.752172 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.752021 2569 kubelet.go:2451] "Starting kubelet main sync loop" May 31 17:23:11.752172 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.752068 2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 31 17:23:11.765020 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.764995 2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:11.817070 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.817039 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.818280 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.818261 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.818398 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.818298 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.818398 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.818311 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.818398 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.818340 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-63.ec2.internal" May 31 17:23:11.835370 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.835338 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-63.ec2.internal" May 31 17:23:11.835370 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.835373 2569 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-63.ec2.internal\": node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:11.853069 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.853035 2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal"] May 31 17:23:11.853230 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.853109 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.853999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.853982 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.854095 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.854018 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.854095 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.854033 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.855131 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855116 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.855273 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855257 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:11.855321 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855289 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.855867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855848 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.855967 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855877 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.855967 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855890 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.855967 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855898 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.855967 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855922 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.855967 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.855935 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.856989 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.856972 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" May 31 17:23:11.857069 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.857003 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.857708 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.857692 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.857778 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.857724 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.857778 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:11.857740 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.881554 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.881531 2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-63.ec2.internal\" not found" node="ip-10-0-142-63.ec2.internal" May 31 17:23:11.886273 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.886250 2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-63.ec2.internal\" not found" node="ip-10-0-142-63.ec2.internal" May 31 17:23:11.886385 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.886341 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:11.987150 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:11.987112 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:12.053808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.053724 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da8596877440b6b2220fdfd1bbae2f8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"da8596877440b6b2220fdfd1bbae2f8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:12.053808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.053757 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da8596877440b6b2220fdfd1bbae2f8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"da8596877440b6b2220fdfd1bbae2f8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:12.053808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.053774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0306ae9d24fceb26999b9d7538d5c419-config\") pod \"kube-apiserver-proxy-ip-10-0-142-63.ec2.internal\" (UID: \"0306ae9d24fceb26999b9d7538d5c419\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" May 31 17:23:12.087211 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.087177 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:12.154615 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.154577 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da8596877440b6b2220fdfd1bbae2f8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"da8596877440b6b2220fdfd1bbae2f8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:12.154615 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.154590 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da8596877440b6b2220fdfd1bbae2f8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"da8596877440b6b2220fdfd1bbae2f8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:12.154806 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.154622 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da8596877440b6b2220fdfd1bbae2f8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"da8596877440b6b2220fdfd1bbae2f8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:12.154806 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.154681 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0306ae9d24fceb26999b9d7538d5c419-config\") pod \"kube-apiserver-proxy-ip-10-0-142-63.ec2.internal\" (UID: \"0306ae9d24fceb26999b9d7538d5c419\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" May 31 17:23:12.154806 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.154656 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da8596877440b6b2220fdfd1bbae2f8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"da8596877440b6b2220fdfd1bbae2f8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:12.154806 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.154717 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0306ae9d24fceb26999b9d7538d5c419-config\") pod \"kube-apiserver-proxy-ip-10-0-142-63.ec2.internal\" (UID: \"0306ae9d24fceb26999b9d7538d5c419\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" May 31 17:23:12.183965 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.183930 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:12.187395 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.187374 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:12.189585 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.189569 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" May 31 17:23:12.288451 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.288411 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:12.389002 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.388905 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:12.489434 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.489396 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found" May 31 17:23:12.515345 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.515323 2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:12.548761 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.548735 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 31 17:23:12.549285 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.548890 2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 31 17:23:12.549285 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.548922 2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 31 17:23:12.552890 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.552867 2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" May 31 17:23:12.579354 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.579333 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 31 17:23:12.580549 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.580537 2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" May 31 17:23:12.594960 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.594928 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 31 17:23:12.608544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.608515 2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:12.625790 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.625759 2569 apiserver.go:52] "Watching apiserver" May 31 17:23:12.637020 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.636990 2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 31 17:23:12.637918 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.637890 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-7f4sn","openshift-network-operator/iptables-alerter-t6pfn","openshift-ovn-kubernetes/ovnkube-node-f6jfx","kube-system/konnectivity-agent-lbz6c","kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh","openshift-cluster-node-tuning-operator/tuned-7b6df","openshift-image-registry/node-ca-f5jtz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal","openshift-multus/multus-additional-cni-plugins-4qrjg","openshift-multus/network-metrics-daemon-kfgfg","openshift-multus/multus-6qkjl"] May 31 17:23:12.641575 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.641532 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:12.641646 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.641614 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.644054 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.644035 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.645909 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.645891 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.648447 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.648428 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.650365 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.650349 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:12.650448 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.650407 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:12.651778 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.651759 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 31 17:23:12.652313 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.652298 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:12.652394 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.652347 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:12.653867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.653845 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 31 17:23:12.653961 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.653845 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 31 17:23:12.653961 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.653850 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 31 17:23:12.654069 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.653863 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 31 17:23:12.654119 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.654085 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 31 17:23:12.654263 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.654245 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 31 17:23:12.654326 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.654276 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 31 17:23:12.654326 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.654286 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 31 17:23:12.654326 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.654296 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 31 17:23:12.654441 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.654326 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 31 17:23:12.654595 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.654582 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 31 17:23:12.655059 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655041 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.655444 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655415 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 31 17:23:12.655555 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655445 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m8jn5\"" May 31 17:23:12.655555 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655534 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 31 17:23:12.655555 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655536 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 31 17:23:12.655736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655564 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jkk2h\"" May 31 17:23:12.655736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655591 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gjmmh\"" May 31 17:23:12.655736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655682 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c8zlj\"" May 31 17:23:12.655896 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.655766 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bsp66\"" May 31 17:23:12.657003 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.656824 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-tmp\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657003 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.656856 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4vj7\" (UniqueName: \"kubernetes.io/projected/829a36da-0012-4624-8443-6808a574c032-kube-api-access-g4vj7\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:12.657003 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.656886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klv8j\" (UniqueName: \"kubernetes.io/projected/548ef623-526e-4b47-a497-22ecfea7a2df-kube-api-access-klv8j\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.657003 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.656912 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4b2de9f-9753-4052-bc53-0c01558ba7b0-konnectivity-ca\") pod \"konnectivity-agent-lbz6c\" (UID: \"d4b2de9f-9753-4052-bc53-0c01558ba7b0\") " pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:12.657003 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.656937 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-registration-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.657003 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.656995 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smdrt\" (UniqueName: \"kubernetes.io/projected/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-kube-api-access-smdrt\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.657261 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657039 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvcql\" (UniqueName: \"kubernetes.io/projected/3076a993-9118-4289-8f14-a8e9349d37d0-kube-api-access-nvcql\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.657261 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657084 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-cnibin\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.657261 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657114 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysctl-d\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657261 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657143 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:12.657261 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657175 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.657261 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657210 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28fb\" (UniqueName: \"kubernetes.io/projected/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-kube-api-access-s28fb\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657483 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657302 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.657483 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657338 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-system-cni-dir\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.657483 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657382 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-os-release\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.657483 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657406 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysctl-conf\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657483 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-run\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657483 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657452 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-host\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657483 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657471 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-tuned\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657504 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-socket-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657528 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657547 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657573 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqlp\" (UniqueName: \"kubernetes.io/projected/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-kube-api-access-fvqlp\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657593 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-kubernetes\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657614 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-lib-modules\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-var-lib-kubelet\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657645 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-sys-fs\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657669 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3076a993-9118-4289-8f14-a8e9349d37d0-host\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657693 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-cni-binary-copy\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657726 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3076a993-9118-4289-8f14-a8e9349d37d0-serviceca\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.657760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657750 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657772 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-host-slash\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657803 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-systemd\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657816 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-sys\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657847 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657869 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-iptables-alerter-script\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-modprobe-d\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657907 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysconfig\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657934 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4b2de9f-9753-4052-bc53-0c01558ba7b0-agent-certs\") pod \"konnectivity-agent-lbz6c\" (UID: \"d4b2de9f-9753-4052-bc53-0c01558ba7b0\") " pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:12.658186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.657959 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-device-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.658595 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.658207 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.660452 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.660436 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qkjl" May 31 17:23:12.665232 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.664886 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 31 17:23:12.665232 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.664927 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 31 17:23:12.665232 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.664998 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 31 17:23:12.665232 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.664885 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 31 17:23:12.665232 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.665069 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 31 17:23:12.665232 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.665175 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 31 17:23:12.667284 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.667264 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 31 17:23:12.667402 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.667324 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l5gjr\"" May 31 17:23:12.667402 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.667360 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 31 17:23:12.667402 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.667326 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 31 17:23:12.667402 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.667331 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6t9nl\"" May 31 17:23:12.667402 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.667383 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-trkdt\"" May 31 17:23:12.667615 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.667446 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 31 17:23:12.671059 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.671042 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 31 17:23:12.685403 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.685379 2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 31 17:23:12.716803 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:12.716764 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0306ae9d24fceb26999b9d7538d5c419.slice/crio-ffd263e4df1eee4ca64a680c14e34004d5646ac811eae74e6a5f233567b22a9f WatchSource:0}: Error finding container ffd263e4df1eee4ca64a680c14e34004d5646ac811eae74e6a5f233567b22a9f: Status 404 returned error can't find the container with id ffd263e4df1eee4ca64a680c14e34004d5646ac811eae74e6a5f233567b22a9f May 31 17:23:12.717047 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:12.717026 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8596877440b6b2220fdfd1bbae2f8d.slice/crio-c89378518c528b2f4c628caaba6ccbecb71570da9c2348c7ce17c623132f18ae WatchSource:0}: Error finding container c89378518c528b2f4c628caaba6ccbecb71570da9c2348c7ce17c623132f18ae: Status 404 returned error can't find the container with id c89378518c528b2f4c628caaba6ccbecb71570da9c2348c7ce17c623132f18ae May 31 17:23:12.722824 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.722803 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 17:23:12.730584 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.730557 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-30 17:18:11 +0000 UTC" deadline="2027-11-07 13:18:38.59482225 +0000 UTC" May 31 17:23:12.730670 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.730585 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12595h55m25.864240962s" May 31 17:23:12.750631 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.750604 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l5t5q" May 31 17:23:12.753950 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.753928 2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 31 17:23:12.756217 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.756175 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" event={"ID":"0306ae9d24fceb26999b9d7538d5c419","Type":"ContainerStarted","Data":"ffd263e4df1eee4ca64a680c14e34004d5646ac811eae74e6a5f233567b22a9f"} May 31 17:23:12.757079 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.757058 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" event={"ID":"da8596877440b6b2220fdfd1bbae2f8d","Type":"ContainerStarted","Data":"c89378518c528b2f4c628caaba6ccbecb71570da9c2348c7ce17c623132f18ae"} May 31 17:23:12.758261 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758246 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvcql\" (UniqueName: \"kubernetes.io/projected/3076a993-9118-4289-8f14-a8e9349d37d0-kube-api-access-nvcql\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.758320 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758275 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-os-release\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.758320 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758295 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-cni-multus\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.758383 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758318 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-systemd-units\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.758383 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758340 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-var-lib-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.758383 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758362 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74g7\" (UniqueName: \"kubernetes.io/projected/2da2484b-d8b0-4de8-a4fd-ba140b62a989-kube-api-access-x74g7\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.758383 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758380 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s28fb\" (UniqueName: \"kubernetes.io/projected/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-kube-api-access-s28fb\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758505 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-conf-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.758505 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758416 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-cni-bin\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.758505 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758438 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.758505 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758457 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-system-cni-dir\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758510 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysctl-conf\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758533 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-run\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758549 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-system-cni-dir\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758570 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758555 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-host\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758610 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-run\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758619 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-k8s-cni-cncf-io\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758645 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-run-netns\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.758654 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758650 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-host\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-etc-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758685 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysctl-conf\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758688 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758763 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758765 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758833 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqlp\" (UniqueName: \"kubernetes.io/projected/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-kube-api-access-fvqlp\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758904 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758920 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-kubernetes\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758953 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-lib-modules\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758985 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-ovn\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.758999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.758997 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-kubernetes\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759014 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-env-overrides\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759040 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovnkube-script-lib\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759068 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-cni-binary-copy\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759091 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-lib-modules\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759093 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-netns\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759138 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-host-slash\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759159 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-systemd\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759164 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-host-slash\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759173 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-sys\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759194 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-systemd\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759219 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-log-socket\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759237 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759232 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-sys\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759257 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysconfig\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759278 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4b2de9f-9753-4052-bc53-0c01558ba7b0-agent-certs\") pod \"konnectivity-agent-lbz6c\" (UID: \"d4b2de9f-9753-4052-bc53-0c01558ba7b0\") " pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:12.759556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759290 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysconfig\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759293 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-device-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759311 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-tmp\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759327 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-daemon-config\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759346 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klv8j\" (UniqueName: \"kubernetes.io/projected/548ef623-526e-4b47-a497-22ecfea7a2df-kube-api-access-klv8j\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759371 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4b2de9f-9753-4052-bc53-0c01558ba7b0-konnectivity-ca\") pod \"konnectivity-agent-lbz6c\" (UID: \"d4b2de9f-9753-4052-bc53-0c01558ba7b0\") " pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759396 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-registration-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759397 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-device-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759420 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-cnibin\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759445 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysctl-d\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759483 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759526 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-multus-certs\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759550 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-cnibin\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759573 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759596 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-registration-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759607 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759633 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-hostroot\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.760255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759627 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759722 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-cni-binary-copy\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760058 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4b2de9f-9753-4052-bc53-0c01558ba7b0-konnectivity-ca\") pod \"konnectivity-agent-lbz6c\" (UID: \"d4b2de9f-9753-4052-bc53-0c01558ba7b0\") " pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbk2b\" (UniqueName: \"kubernetes.io/projected/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-kube-api-access-xbk2b\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760181 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760186 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-kubelet\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.759772 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-sysctl-d\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760251 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovn-node-metrics-cert\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760292 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-os-release\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760312 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-tuned\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760337 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-cnibin\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760362 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-slash\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760374 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/548ef623-526e-4b47-a497-22ecfea7a2df-os-release\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760406 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-socket-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760448 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-var-lib-kubelet\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760478 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-kubelet\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760524 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovnkube-config\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.760906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760547 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-var-lib-kubelet\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760547 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-socket-dir\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760551 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-sys-fs\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760624 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-sys-fs\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760653 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3076a993-9118-4289-8f14-a8e9349d37d0-host\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760679 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3076a993-9118-4289-8f14-a8e9349d37d0-serviceca\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760702 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760728 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760772 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-system-cni-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760795 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-cni-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760821 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-iptables-alerter-script\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.760852 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760872 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-modprobe-d\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.760899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-cni-binary-copy\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.760945 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:13.260893895 +0000 UTC m=+2.105520902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761056 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-socket-dir-parent\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761085 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-cni-bin\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.761622 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761090 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3076a993-9118-4289-8f14-a8e9349d37d0-serviceca\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761107 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-cni-netd\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761136 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3076a993-9118-4289-8f14-a8e9349d37d0-host\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761184 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4vj7\" (UniqueName: \"kubernetes.io/projected/829a36da-0012-4624-8443-6808a574c032-kube-api-access-g4vj7\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-etc-kubernetes\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761242 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-systemd\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-node-log\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761308 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smdrt\" (UniqueName: \"kubernetes.io/projected/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-kube-api-access-smdrt\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761367 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-iptables-alerter-script\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761436 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-modprobe-d\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.762090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.761568 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/548ef623-526e-4b47-a497-22ecfea7a2df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.763129 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.763107 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-etc-tuned\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.763203 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.763188 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-tmp\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.763444 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.763426 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4b2de9f-9753-4052-bc53-0c01558ba7b0-agent-certs\") pod \"konnectivity-agent-lbz6c\" (UID: \"d4b2de9f-9753-4052-bc53-0c01558ba7b0\") " pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:12.769598 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.769579 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28fb\" (UniqueName: \"kubernetes.io/projected/0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6-kube-api-access-s28fb\") pod \"tuned-7b6df\" (UID: \"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.772746 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.772726 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvcql\" (UniqueName: \"kubernetes.io/projected/3076a993-9118-4289-8f14-a8e9349d37d0-kube-api-access-nvcql\") pod \"node-ca-f5jtz\" (UID: \"3076a993-9118-4289-8f14-a8e9349d37d0\") " pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.773139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.773121 2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:12.774043 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.774030 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l5t5q" May 31 17:23:12.779071 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.779052 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:12.779134 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.779077 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:12.779134 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.779092 2569 projected.go:194] Error preparing data for projected volume kube-api-access-2cxc6 for pod openshift-network-diagnostics/network-check-target-7f4sn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:12.779211 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:12.779154 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6 podName:03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:13.279136227 +0000 UTC m=+2.123763237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2cxc6" (UniqueName: "kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6") pod "network-check-target-7f4sn" (UID: "03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:12.781397 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.781367 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klv8j\" (UniqueName: \"kubernetes.io/projected/548ef623-526e-4b47-a497-22ecfea7a2df-kube-api-access-klv8j\") pod \"multus-additional-cni-plugins-4qrjg\" (UID: \"548ef623-526e-4b47-a497-22ecfea7a2df\") " pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:12.782135 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.782110 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqlp\" (UniqueName: \"kubernetes.io/projected/261abe6a-f1bc-4bdf-97c3-9e39140ab76a-kube-api-access-fvqlp\") pod \"iptables-alerter-t6pfn\" (UID: \"261abe6a-f1bc-4bdf-97c3-9e39140ab76a\") " pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:12.782206 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.782167 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smdrt\" (UniqueName: \"kubernetes.io/projected/1cd11314-a4a5-45c3-b3a1-be8dc61bb44b-kube-api-access-smdrt\") pod \"aws-ebs-csi-driver-node-4gpxh\" (UID: \"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.787156 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.787135 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4vj7\" (UniqueName: \"kubernetes.io/projected/829a36da-0012-4624-8443-6808a574c032-kube-api-access-g4vj7\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:12.861708 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861677 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-system-cni-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861708 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861708 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-cni-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861727 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-cni-binary-copy\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861744 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-socket-dir-parent\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861813 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-socket-dir-parent\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861823 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-system-cni-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861830 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-cni-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861833 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-cni-bin\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861926 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-cni-netd\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861925 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-cni-bin\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.861946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861947 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-etc-kubernetes\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861965 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-systemd\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861985 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-cni-netd\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.861987 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-node-log\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862027 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-systemd\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862030 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-node-log\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862048 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-os-release\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862067 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-etc-kubernetes\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862091 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-cni-multus\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862119 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-systemd-units\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862135 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-os-release\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862144 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-var-lib-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862172 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x74g7\" (UniqueName: \"kubernetes.io/projected/2da2484b-d8b0-4de8-a4fd-ba140b62a989-kube-api-access-x74g7\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862198 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-conf-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862199 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-systemd-units\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862208 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-var-lib-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862173 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-cni-multus\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862222 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-cni-bin\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862249 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-conf-dir\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862261 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-cni-bin\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862271 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-k8s-cni-cncf-io\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862290 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-run-netns\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862304 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-etc-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862320 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-cni-binary-copy\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862328 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-ovn\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862351 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-run-netns\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862363 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-etc-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862363 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-ovn\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862379 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-k8s-cni-cncf-io\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862382 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-env-overrides\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862453 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovnkube-script-lib\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862479 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-netns\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862518 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862543 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-log-socket\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862566 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-netns\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862569 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862587 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-run-openvswitch\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862591 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-log-socket\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862610 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862613 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-daemon-config\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862660 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-multus-certs\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862686 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862707 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-run-multus-certs\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862715 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-hostroot\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862755 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862759 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-hostroot\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862778 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbk2b\" (UniqueName: \"kubernetes.io/projected/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-kube-api-access-xbk2b\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862802 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-kubelet\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862827 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovn-node-metrics-cert\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862855 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-cnibin\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862880 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-slash\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862903 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-kubelet\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862909 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-kubelet\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862935 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovnkube-config\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.863737 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862947 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-host-var-lib-kubelet\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.864273 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862952 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2da2484b-d8b0-4de8-a4fd-ba140b62a989-host-slash\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.864273 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862855 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-env-overrides\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.864273 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.862911 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-cnibin\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.864273 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.863078 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-multus-daemon-config\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.864273 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.863088 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovnkube-script-lib\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.864524 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.864466 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovnkube-config\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.865067 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.865051 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2da2484b-d8b0-4de8-a4fd-ba140b62a989-ovn-node-metrics-cert\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.877940 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.877913 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbk2b\" (UniqueName: \"kubernetes.io/projected/9b8bbb19-7e74-4528-aa33-e0446ad7cef4-kube-api-access-xbk2b\") pod \"multus-6qkjl\" (UID: \"9b8bbb19-7e74-4528-aa33-e0446ad7cef4\") " pod="openshift-multus/multus-6qkjl" May 31 17:23:12.884122 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.884098 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74g7\" (UniqueName: \"kubernetes.io/projected/2da2484b-d8b0-4de8-a4fd-ba140b62a989-kube-api-access-x74g7\") pod \"ovnkube-node-f6jfx\" (UID: \"2da2484b-d8b0-4de8-a4fd-ba140b62a989\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:12.960928 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.960842 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:12.968456 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:12.968430 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b2de9f_9753_4052_bc53_0c01558ba7b0.slice/crio-f0e844b1c0f5155ea412f984cb7d5412ce121db7b856c14a1d536c28023940c6 WatchSource:0}: Error finding container f0e844b1c0f5155ea412f984cb7d5412ce121db7b856c14a1d536c28023940c6: Status 404 returned error can't find the container with id f0e844b1c0f5155ea412f984cb7d5412ce121db7b856c14a1d536c28023940c6 May 31 17:23:12.970335 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.970283 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" May 31 17:23:12.977720 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:12.977695 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd11314_a4a5_45c3_b3a1_be8dc61bb44b.slice/crio-68c4e6d3ed4a0ed42770b9e97ebedc500af1b924a5b4da59465cdec65ec27ed6 WatchSource:0}: Error finding container 68c4e6d3ed4a0ed42770b9e97ebedc500af1b924a5b4da59465cdec65ec27ed6: Status 404 returned error can't find the container with id 68c4e6d3ed4a0ed42770b9e97ebedc500af1b924a5b4da59465cdec65ec27ed6 May 31 17:23:12.989888 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.989868 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7b6df" May 31 17:23:12.993451 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:12.993430 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f5jtz" May 31 17:23:12.996198 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:12.996173 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd8d93d_8649_44ec_a5c3_7ea7efcabbe6.slice/crio-3071bf1eeb9861a859e2d12e2b221efffadf7ecc71228fc54ab00300b18e5564 WatchSource:0}: Error finding container 3071bf1eeb9861a859e2d12e2b221efffadf7ecc71228fc54ab00300b18e5564: Status 404 returned error can't find the container with id 3071bf1eeb9861a859e2d12e2b221efffadf7ecc71228fc54ab00300b18e5564 May 31 17:23:13.000416 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:13.000392 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3076a993_9118_4289_8f14_a8e9349d37d0.slice/crio-68701a96335f4770fc7bc32bfa36f71ba45f75c3d603eab0b15e4260a6d7e3e3 WatchSource:0}: Error finding container 68701a96335f4770fc7bc32bfa36f71ba45f75c3d603eab0b15e4260a6d7e3e3: Status 404 returned error can't find the container with id 68701a96335f4770fc7bc32bfa36f71ba45f75c3d603eab0b15e4260a6d7e3e3 May 31 17:23:13.024110 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.024081 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" May 31 17:23:13.031459 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.031432 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t6pfn" May 31 17:23:13.031609 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:13.031581 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548ef623_526e_4b47_a497_22ecfea7a2df.slice/crio-0dd301f1e329950ea2d478eed9c921daa169c85dd458dbb02d24317541c5809d WatchSource:0}: Error finding container 0dd301f1e329950ea2d478eed9c921daa169c85dd458dbb02d24317541c5809d: Status 404 returned error can't find the container with id 0dd301f1e329950ea2d478eed9c921daa169c85dd458dbb02d24317541c5809d May 31 17:23:13.037863 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.037845 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:13.038036 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:13.038016 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261abe6a_f1bc_4bdf_97c3_9e39140ab76a.slice/crio-929bc3cf8e3989cb4b221916e5eddbd72f1a3eb086135d90c95ee0c369569edb WatchSource:0}: Error finding container 929bc3cf8e3989cb4b221916e5eddbd72f1a3eb086135d90c95ee0c369569edb: Status 404 returned error can't find the container with id 929bc3cf8e3989cb4b221916e5eddbd72f1a3eb086135d90c95ee0c369569edb May 31 17:23:13.043005 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.042811 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qkjl" May 31 17:23:13.044627 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:13.044582 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da2484b_d8b0_4de8_a4fd_ba140b62a989.slice/crio-8ba01a883d168524fa38b75e69a0eb88478243bd9f2f64ec09797871dfaf566c WatchSource:0}: Error finding container 8ba01a883d168524fa38b75e69a0eb88478243bd9f2f64ec09797871dfaf566c: Status 404 returned error can't find the container with id 8ba01a883d168524fa38b75e69a0eb88478243bd9f2f64ec09797871dfaf566c May 31 17:23:13.049149 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:23:13.049126 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8bbb19_7e74_4528_aa33_e0446ad7cef4.slice/crio-d744c8d0ba91cbaf3a1359cc25fb4938e9788fb750473291ef6aaf9e06c6e4a4 WatchSource:0}: Error finding container d744c8d0ba91cbaf3a1359cc25fb4938e9788fb750473291ef6aaf9e06c6e4a4: Status 404 returned error can't find the container with id d744c8d0ba91cbaf3a1359cc25fb4938e9788fb750473291ef6aaf9e06c6e4a4 May 31 17:23:13.265376 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.265295 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:13.265552 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:13.265452 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:13.265552 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:13.265548 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:14.265529416 +0000 UTC m=+3.110156424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:13.366423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.366389 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:13.366622 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:13.366591 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:13.366622 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:13.366609 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:13.366622 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:13.366622 2569 projected.go:194] Error preparing data for projected volume kube-api-access-2cxc6 for pod openshift-network-diagnostics/network-check-target-7f4sn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:13.366755 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:13.366678 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6 podName:03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:14.366663375 +0000 UTC m=+3.211290385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cxc6" (UniqueName: "kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6") pod "network-check-target-7f4sn" (UID: "03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:13.406434 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.406395 2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:13.774696 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.774558 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-30 17:18:12 +0000 UTC" deadline="2027-11-26 04:27:22.735236998 +0000 UTC" May 31 17:23:13.774696 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.774594 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13043h4m8.960645972s" May 31 17:23:13.774696 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.774650 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qkjl" event={"ID":"9b8bbb19-7e74-4528-aa33-e0446ad7cef4","Type":"ContainerStarted","Data":"d744c8d0ba91cbaf3a1359cc25fb4938e9788fb750473291ef6aaf9e06c6e4a4"} May 31 17:23:13.783028 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.782979 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t6pfn" event={"ID":"261abe6a-f1bc-4bdf-97c3-9e39140ab76a","Type":"ContainerStarted","Data":"929bc3cf8e3989cb4b221916e5eddbd72f1a3eb086135d90c95ee0c369569edb"} May 31 17:23:13.802698 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.802659 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" event={"ID":"548ef623-526e-4b47-a497-22ecfea7a2df","Type":"ContainerStarted","Data":"0dd301f1e329950ea2d478eed9c921daa169c85dd458dbb02d24317541c5809d"} May 31 17:23:13.809473 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.809434 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lbz6c" event={"ID":"d4b2de9f-9753-4052-bc53-0c01558ba7b0","Type":"ContainerStarted","Data":"f0e844b1c0f5155ea412f984cb7d5412ce121db7b856c14a1d536c28023940c6"} May 31 17:23:13.815531 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.815486 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"8ba01a883d168524fa38b75e69a0eb88478243bd9f2f64ec09797871dfaf566c"} May 31 17:23:13.826670 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.826633 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f5jtz" event={"ID":"3076a993-9118-4289-8f14-a8e9349d37d0","Type":"ContainerStarted","Data":"68701a96335f4770fc7bc32bfa36f71ba45f75c3d603eab0b15e4260a6d7e3e3"} May 31 17:23:13.831423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.831394 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7b6df" event={"ID":"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6","Type":"ContainerStarted","Data":"3071bf1eeb9861a859e2d12e2b221efffadf7ecc71228fc54ab00300b18e5564"} May 31 17:23:13.836291 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:13.836263 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" event={"ID":"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b","Type":"ContainerStarted","Data":"68c4e6d3ed4a0ed42770b9e97ebedc500af1b924a5b4da59465cdec65ec27ed6"} May 31 17:23:14.273708 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:14.273188 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:14.273708 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:14.273380 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:14.273708 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:14.273478 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:16.273456896 +0000 UTC m=+5.118083906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:14.373969 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:14.373930 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:14.374151 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:14.374094 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:14.374151 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:14.374113 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:14.374151 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:14.374125 2569 projected.go:194] Error preparing data for projected volume kube-api-access-2cxc6 for pod openshift-network-diagnostics/network-check-target-7f4sn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:14.374318 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:14.374181 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6 podName:03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:16.374162825 +0000 UTC m=+5.218789827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cxc6" (UniqueName: "kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6") pod "network-check-target-7f4sn" (UID: "03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:14.753680 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:14.752877 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:14.753680 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:14.753004 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:14.753680 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:14.753451 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:14.753680 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:14.753568 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:14.775093 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:14.775019 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-30 17:18:12 +0000 UTC" deadline="2028-02-28 06:05:36.45633316 +0000 UTC" May 31 17:23:14.775093 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:14.775058 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15300h42m21.681279078s" May 31 17:23:15.444368 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:15.444332 2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:16.291459 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:16.291421 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:16.291951 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:16.291641 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:16.291951 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:16.291710 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:20.29169115 +0000 UTC m=+9.136318150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:16.392375 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:16.392338 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:16.392580 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:16.392516 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:16.392580 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:16.392535 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:16.392580 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:16.392545 2569 projected.go:194] Error preparing data for projected volume kube-api-access-2cxc6 for pod openshift-network-diagnostics/network-check-target-7f4sn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:16.392689 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:16.392590 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6 podName:03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:20.392576819 +0000 UTC m=+9.237203812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cxc6" (UniqueName: "kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6") pod "network-check-target-7f4sn" (UID: "03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:16.752425 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:16.752387 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:16.752638 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:16.752535 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:16.752970 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:16.752931 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:16.753063 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:16.753033 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:18.753839 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:18.753170 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:18.753839 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:18.753317 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:18.753839 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:18.753693 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:18.753839 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:18.753790 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:20.327366 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:20.327326 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:20.327854 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:20.327462 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:20.327854 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:20.327532 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:28.327514719 +0000 UTC m=+17.172141734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:20.428637 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:20.428532 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:20.428830 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:20.428809 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:20.428890 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:20.428831 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:20.428890 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:20.428845 2569 projected.go:194] Error preparing data for projected volume kube-api-access-2cxc6 for pod openshift-network-diagnostics/network-check-target-7f4sn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:20.428982 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:20.428905 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6 podName:03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:28.428886126 +0000 UTC m=+17.273513124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cxc6" (UniqueName: "kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6") pod "network-check-target-7f4sn" (UID: "03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:20.752623 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:20.752531 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:20.752623 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:20.752557 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:20.752820 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:20.752682 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:20.752873 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:20.752809 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:22.390969 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.390924 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-27xb9"] May 31 17:23:22.393669 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.393637 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.398532 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.398507 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 31 17:23:22.398668 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.398559 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 31 17:23:22.398668 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.398512 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g4cnh\"" May 31 17:23:22.443320 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.443280 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bc6e587-62f0-4943-ad56-66ac1707325e-hosts-file\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.443485 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.443342 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl7jn\" (UniqueName: \"kubernetes.io/projected/3bc6e587-62f0-4943-ad56-66ac1707325e-kube-api-access-kl7jn\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.443485 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.443441 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc6e587-62f0-4943-ad56-66ac1707325e-tmp-dir\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.544050 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.544013 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bc6e587-62f0-4943-ad56-66ac1707325e-hosts-file\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.544050 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.544058 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kl7jn\" (UniqueName: \"kubernetes.io/projected/3bc6e587-62f0-4943-ad56-66ac1707325e-kube-api-access-kl7jn\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.544274 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.544125 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc6e587-62f0-4943-ad56-66ac1707325e-tmp-dir\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.544274 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.544152 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bc6e587-62f0-4943-ad56-66ac1707325e-hosts-file\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.544438 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.544420 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc6e587-62f0-4943-ad56-66ac1707325e-tmp-dir\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.554715 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.554688 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl7jn\" (UniqueName: \"kubernetes.io/projected/3bc6e587-62f0-4943-ad56-66ac1707325e-kube-api-access-kl7jn\") pod \"node-resolver-27xb9\" (UID: \"3bc6e587-62f0-4943-ad56-66ac1707325e\") " pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.704405 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.704307 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-27xb9" May 31 17:23:22.752577 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.752314 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:22.752742 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:22.752381 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:22.752742 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:22.752696 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:22.752742 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:22.752720 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:24.753104 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:24.753068 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:24.753583 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:24.753074 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:24.753583 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:24.753193 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:24.753583 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:24.753266 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:26.752880 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:26.752835 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:26.753337 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:26.752846 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:26.753337 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:26.753033 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:26.753337 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:26.753065 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:28.386925 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:28.386890 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:28.387351 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:28.387073 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:28.387351 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:28.387146 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:44.387129698 +0000 UTC m=+33.231756695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:28.487950 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:28.487908 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:28.488142 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:28.488079 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:28.488142 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:28.488105 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:28.488142 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:28.488119 2569 projected.go:194] Error preparing data for projected volume kube-api-access-2cxc6 for pod openshift-network-diagnostics/network-check-target-7f4sn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:28.488303 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:28.488180 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6 podName:03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:44.488166939 +0000 UTC m=+33.332793932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cxc6" (UniqueName: "kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6") pod "network-check-target-7f4sn" (UID: "03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:28.752336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:28.752246 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:28.752505 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:28.752243 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:28.752505 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:28.752390 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:28.752505 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:28.752437 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:30.753009 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:30.752965 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:30.753564 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:30.753096 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:30.753564 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:30.753163 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:30.753564 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:30.753266 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:32.753275 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.753036 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:32.753696 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:32.753413 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:32.753818 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.753802 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:32.753898 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:32.753883 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:32.893459 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.892761 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" event={"ID":"0306ae9d24fceb26999b9d7538d5c419","Type":"ContainerStarted","Data":"2742c4622f2a2bc11796d6ff17aa2f57a7046b0a9d99d1cfea584bf79566b778"} May 31 17:23:32.908818 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.908792 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:23:32.912240 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.910635 2569 generic.go:358] "Generic (PLEG): container finished" podID="2da2484b-d8b0-4de8-a4fd-ba140b62a989" containerID="dbb80e2d0b121138a6208d91dd4053130b5523facb47c44a4e7ac8d3881beeba" exitCode=1 May 31 17:23:32.912240 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.910725 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"44c9dc714a4ec5866526e990fb51c0a7b8acb1d265be73150c46123edef91f9c"} May 31 17:23:32.912240 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.910753 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"4da51c9ea89798c7311d7f4713716c1b540f7963b48109a09599e6fceb478c42"} May 31 17:23:32.912240 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.910766 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerDied","Data":"dbb80e2d0b121138a6208d91dd4053130b5523facb47c44a4e7ac8d3881beeba"} May 31 17:23:32.912240 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.910781 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"3e3944c6b211338778d604538c400bf96e7d67808867c4aa501199e5d74fd9ce"} May 31 17:23:32.914964 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.914893 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7b6df" event={"ID":"0dd8d93d-8649-44ec-a5c3-7ea7efcabbe6","Type":"ContainerStarted","Data":"a76fd8071c6571a3941a942ae606387a644633641233aa49e1c17fa1043adc54"} May 31 17:23:32.917064 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.916521 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-27xb9" event={"ID":"3bc6e587-62f0-4943-ad56-66ac1707325e","Type":"ContainerStarted","Data":"c21597b5d6d573d90f3e8ec4cb10f7e0250b2658e221b04e707eb9c98052cffa"} May 31 17:23:32.917064 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.916817 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" podStartSLOduration=20.916802599 podStartE2EDuration="20.916802599s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:23:32.916759058 +0000 UTC m=+21.761386073" watchObservedRunningTime="2026-05-31 17:23:32.916802599 +0000 UTC m=+21.761429614" May 31 17:23:32.918092 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.918065 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qkjl" event={"ID":"9b8bbb19-7e74-4528-aa33-e0446ad7cef4","Type":"ContainerStarted","Data":"cae098cdbad9feded3c52b30dd3d63717653123bcdccb1d9d32dbe70098812b5"} May 31 17:23:32.951283 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:32.951234 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7b6df" podStartSLOduration=2.649251878 podStartE2EDuration="21.951217905s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:12.998165081 +0000 UTC m=+1.842792088" lastFinishedPulling="2026-05-31 17:23:32.300131119 +0000 UTC m=+21.144758115" observedRunningTime="2026-05-31 17:23:32.951141563 +0000 UTC m=+21.795768600" watchObservedRunningTime="2026-05-31 17:23:32.951217905 +0000 UTC m=+21.795844921" May 31 17:23:33.164729 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.164537 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6qkjl" podStartSLOduration=1.581888687 podStartE2EDuration="21.164524018s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.050829419 +0000 UTC m=+1.895456411" lastFinishedPulling="2026-05-31 17:23:32.633464746 +0000 UTC m=+21.478091742" observedRunningTime="2026-05-31 17:23:33.163920907 +0000 UTC m=+22.008547933" watchObservedRunningTime="2026-05-31 17:23:33.164524018 +0000 UTC m=+22.009151031" May 31 17:23:33.913022 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.912997 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 31 17:23:33.921408 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.921382 2569 generic.go:358] "Generic (PLEG): container finished" podID="da8596877440b6b2220fdfd1bbae2f8d" containerID="c7355b648f77d72f72c862c7d836b0b1052c3b1f86827a28592fb62fc805ac41" exitCode=0 May 31 17:23:33.921556 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.921463 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" event={"ID":"da8596877440b6b2220fdfd1bbae2f8d","Type":"ContainerDied","Data":"c7355b648f77d72f72c862c7d836b0b1052c3b1f86827a28592fb62fc805ac41"} May 31 17:23:33.924082 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.924055 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:23:33.924404 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.924386 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"a7ab9eb7a6e5a2e48238c6a4c769db7ec722b2ecedc58a06fff12315f40045d1"} May 31 17:23:33.924474 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.924414 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"dba327a361ced3c6ce69b8ccfb05ef22d3fe9f873fd3f7a27e52b58edd6c969e"} May 31 17:23:33.925828 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.925801 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f5jtz" event={"ID":"3076a993-9118-4289-8f14-a8e9349d37d0","Type":"ContainerStarted","Data":"8dfdb132c758c4cb3da643139b7fa5cd438f2b33602c8de858df4d559e88e0b7"} May 31 17:23:33.927171 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.927145 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" event={"ID":"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b","Type":"ContainerStarted","Data":"fa4f16ab73457a70efea436fa34c3df9f16847abd22f0c9748f57cd430d8776b"} May 31 17:23:33.927258 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.927176 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" event={"ID":"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b","Type":"ContainerStarted","Data":"c842f409b3bcca62f9d78b4007c8065f5d874f50a7c298ca85940bcff96207df"} May 31 17:23:33.928337 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.928285 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-27xb9" event={"ID":"3bc6e587-62f0-4943-ad56-66ac1707325e","Type":"ContainerStarted","Data":"547cc10ccb2753ba95cf2dec24f555d3d59f20a82bea7643823e6dc40984166b"} May 31 17:23:33.929528 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.929487 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t6pfn" event={"ID":"261abe6a-f1bc-4bdf-97c3-9e39140ab76a","Type":"ContainerStarted","Data":"70fbe4da5b421589a0d96e95b7b1a34dd9c0954098c1d0aabeca83b360e7ac52"} May 31 17:23:33.930897 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.930875 2569 generic.go:358] "Generic (PLEG): container finished" podID="548ef623-526e-4b47-a497-22ecfea7a2df" containerID="ea0653f9f0dfe3d5045e6dfaa3ed4fff06fe208fcfbed280b0add89d42d51398" exitCode=0 May 31 17:23:33.930987 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.930949 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" event={"ID":"548ef623-526e-4b47-a497-22ecfea7a2df","Type":"ContainerDied","Data":"ea0653f9f0dfe3d5045e6dfaa3ed4fff06fe208fcfbed280b0add89d42d51398"} May 31 17:23:33.932156 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:33.932102 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lbz6c" event={"ID":"d4b2de9f-9753-4052-bc53-0c01558ba7b0","Type":"ContainerStarted","Data":"5d606a6f942be99c337c815293be022ae5336e8f2b6d4951749ff6897c031bd1"} May 31 17:23:34.010302 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.010262 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f5jtz" podStartSLOduration=3.716135997 podStartE2EDuration="23.010247555s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.002007247 +0000 UTC m=+1.846634240" lastFinishedPulling="2026-05-31 17:23:32.296118793 +0000 UTC m=+21.140745798" observedRunningTime="2026-05-31 17:23:33.982899423 +0000 UTC m=+22.827526435" watchObservedRunningTime="2026-05-31 17:23:34.010247555 +0000 UTC m=+22.854874567" May 31 17:23:34.047797 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.047698 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t6pfn" podStartSLOduration=2.79189801 podStartE2EDuration="22.047682673s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.040365174 +0000 UTC m=+1.884992167" lastFinishedPulling="2026-05-31 17:23:32.296149831 +0000 UTC m=+21.140776830" observedRunningTime="2026-05-31 17:23:34.010711174 +0000 UTC m=+22.855338210" watchObservedRunningTime="2026-05-31 17:23:34.047682673 +0000 UTC m=+22.892309678" May 31 17:23:34.093592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.093531 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-27xb9" podStartSLOduration=12.093513752 podStartE2EDuration="12.093513752s" podCreationTimestamp="2026-05-31 17:23:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:23:34.047967282 +0000 UTC m=+22.892594296" watchObservedRunningTime="2026-05-31 17:23:34.093513752 +0000 UTC m=+22.938140764" May 31 17:23:34.093755 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.093617 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lbz6c" podStartSLOduration=8.690983134 podStartE2EDuration="23.093612935s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:12.969983259 +0000 UTC m=+1.814610253" lastFinishedPulling="2026-05-31 17:23:27.372613047 +0000 UTC m=+16.217240054" observedRunningTime="2026-05-31 17:23:34.082276832 +0000 UTC m=+22.926903846" watchObservedRunningTime="2026-05-31 17:23:34.093612935 +0000 UTC m=+22.938239949" May 31 17:23:34.732089 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.731971 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-31T17:23:33.913018636Z","UUID":"fc3441ab-090f-4435-a6b2-19ea8ec30d52","Handler":null,"Name":"","Endpoint":""} May 31 17:23:34.734607 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.734173 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 31 17:23:34.734607 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.734206 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 31 17:23:34.752762 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.752731 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:34.752920 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.752737 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:34.752920 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:34.752854 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:34.753027 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:34.752971 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:34.936470 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.936430 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" event={"ID":"da8596877440b6b2220fdfd1bbae2f8d","Type":"ContainerStarted","Data":"9cc468d8f8efb545dd60e13b38871f95b15af368447495dd103d8c8a0d685163"} May 31 17:23:34.938511 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.938401 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" event={"ID":"1cd11314-a4a5-45c3-b3a1-be8dc61bb44b","Type":"ContainerStarted","Data":"f7fbe63f5bf5492e87510e38929661753b1bb2fa962fcecd00297aa97471a618"} May 31 17:23:34.963893 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:34.963782 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" podStartSLOduration=22.963765769 podStartE2EDuration="22.963765769s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:23:34.963640463 +0000 UTC m=+23.808267479" watchObservedRunningTime="2026-05-31 17:23:34.963765769 +0000 UTC m=+23.808392785" May 31 17:23:35.018075 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:35.018012 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gpxh" podStartSLOduration=2.298073235 podStartE2EDuration="24.01799119s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:12.979437319 +0000 UTC m=+1.824064316" lastFinishedPulling="2026-05-31 17:23:34.699355275 +0000 UTC m=+23.543982271" observedRunningTime="2026-05-31 17:23:35.01775787 +0000 UTC m=+23.862384886" watchObservedRunningTime="2026-05-31 17:23:35.01799119 +0000 UTC m=+23.862618206" May 31 17:23:35.943659 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:35.943629 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:23:35.944142 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:35.943980 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"c3b51dfb8b9185ee7b18fa20dfb03562e6fa1f3c054b8a3caddd93f836b7d9e5"} May 31 17:23:36.713276 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:36.713236 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:36.713918 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:36.713893 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:36.752675 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:36.752598 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:36.752866 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:36.752734 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:36.752866 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:36.752793 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:36.752979 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:36.752904 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:36.946395 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:36.946298 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:36.946846 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:36.946804 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lbz6c" May 31 17:23:37.955350 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:37.952222 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:23:37.955350 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:37.953870 2569 scope.go:117] "RemoveContainer" containerID="dbb80e2d0b121138a6208d91dd4053130b5523facb47c44a4e7ac8d3881beeba" May 31 17:23:37.955350 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:37.953889 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"a17ca47f4a00810566e966c97f022ad5e3f991679f0f30e722d1a15383902e37"} May 31 17:23:37.955350 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:37.953928 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:37.955350 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:37.953945 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:37.955350 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:37.953956 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:37.976109 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:37.975381 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:37.980052 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:37.979552 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:23:38.752343 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:38.752311 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:38.752533 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:38.752311 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:38.752533 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:38.752417 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:38.752533 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:38.752474 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:38.956053 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:38.955870 2569 generic.go:358] "Generic (PLEG): container finished" podID="548ef623-526e-4b47-a497-22ecfea7a2df" containerID="fd23138e8da833bcf4ee34fa8945a6eed2c0884e5a27531f937efd5313bc6638" exitCode=0 May 31 17:23:38.956601 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:38.955944 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" event={"ID":"548ef623-526e-4b47-a497-22ecfea7a2df","Type":"ContainerDied","Data":"fd23138e8da833bcf4ee34fa8945a6eed2c0884e5a27531f937efd5313bc6638"} May 31 17:23:38.959523 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:38.959504 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:23:38.959906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:38.959883 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" event={"ID":"2da2484b-d8b0-4de8-a4fd-ba140b62a989","Type":"ContainerStarted","Data":"fb5fa81b5a5e3aaeaa76558231486031959a11a0bb162b5d17b9ecb25a3b0a68"} May 31 17:23:39.066370 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:39.066222 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" podStartSLOduration=7.770126792 podStartE2EDuration="27.066206556s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.046086469 +0000 UTC m=+1.890713462" lastFinishedPulling="2026-05-31 17:23:32.342166234 +0000 UTC m=+21.186793226" observedRunningTime="2026-05-31 17:23:39.0648837 +0000 UTC m=+27.909510716" watchObservedRunningTime="2026-05-31 17:23:39.066206556 +0000 UTC m=+27.910833571" May 31 17:23:39.947891 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:39.947808 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kfgfg"] May 31 17:23:39.948061 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:39.947937 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:39.948061 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:39.948019 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:39.959555 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:39.959519 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7f4sn"] May 31 17:23:39.959960 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:39.959655 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:39.959960 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:39.959754 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:39.964039 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:39.964013 2569 generic.go:358] "Generic (PLEG): container finished" podID="548ef623-526e-4b47-a497-22ecfea7a2df" containerID="5fba1d236129ed76541e9299555d1247b6e57f4430c17a53d5846c7e167089ab" exitCode=0 May 31 17:23:39.964906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:39.964885 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" event={"ID":"548ef623-526e-4b47-a497-22ecfea7a2df","Type":"ContainerDied","Data":"5fba1d236129ed76541e9299555d1247b6e57f4430c17a53d5846c7e167089ab"} May 31 17:23:40.967833 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:40.967747 2569 generic.go:358] "Generic (PLEG): container finished" podID="548ef623-526e-4b47-a497-22ecfea7a2df" containerID="2d27ff36608edd132f8dac2520b31e2f3f17ba978525d226f91b5474ac1ed9ba" exitCode=0 May 31 17:23:40.967833 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:40.967789 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" event={"ID":"548ef623-526e-4b47-a497-22ecfea7a2df","Type":"ContainerDied","Data":"2d27ff36608edd132f8dac2520b31e2f3f17ba978525d226f91b5474ac1ed9ba"} May 31 17:23:41.756552 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:41.754635 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:41.756552 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:41.754893 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:41.756552 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:41.755464 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:41.756552 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:41.755626 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:43.752716 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:43.752633 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:43.752716 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:43.752664 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:43.753188 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:43.752775 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:23:43.753188 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:43.752897 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f4sn" podUID="03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96" May 31 17:23:44.403829 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:44.403619 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:44.404003 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:44.403775 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:44.404003 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:44.403934 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:24:16.403918164 +0000 UTC m=+65.248545156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:44.505125 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:44.505090 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:44.505288 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:44.505255 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:44.505288 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:44.505278 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:44.505288 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:44.505289 2569 projected.go:194] Error preparing data for projected volume kube-api-access-2cxc6 for pod openshift-network-diagnostics/network-check-target-7f4sn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:44.505460 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:44.505335 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6 podName:03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96 nodeName:}" failed. No retries permitted until 2026-05-31 17:24:16.505322434 +0000 UTC m=+65.349949427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cxc6" (UniqueName: "kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6") pod "network-check-target-7f4sn" (UID: "03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:45.419402 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.419375 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeReady" May 31 17:23:45.419921 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.419553 2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 31 17:23:45.503074 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.503035 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zmkvc"] May 31 17:23:45.528416 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.528379 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9kf44"] May 31 17:23:45.528612 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.528572 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.533973 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.533951 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 31 17:23:45.534136 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.533987 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 31 17:23:45.534610 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.534563 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-777ll\"" May 31 17:23:45.548017 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.547662 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:45.548341 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.548229 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9kf44"] May 31 17:23:45.548577 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.548530 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zmkvc"] May 31 17:23:45.552297 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.552265 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 31 17:23:45.552297 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.552284 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p8png\"" May 31 17:23:45.552297 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.552292 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 31 17:23:45.552623 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.552601 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 31 17:23:45.612717 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.612685 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/864ff596-a523-4c11-a9bf-f0f15940074f-config-volume\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.612946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.612740 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5n7x\" (UniqueName: \"kubernetes.io/projected/864ff596-a523-4c11-a9bf-f0f15940074f-kube-api-access-v5n7x\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.612946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.612812 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.612946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.612859 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/864ff596-a523-4c11-a9bf-f0f15940074f-tmp-dir\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.612946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.612904 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhzvv\" (UniqueName: \"kubernetes.io/projected/45b5735c-7b24-4029-a4a7-ef51191f5985-kube-api-access-hhzvv\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:45.612946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.612928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:45.713829 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.713734 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/864ff596-a523-4c11-a9bf-f0f15940074f-tmp-dir\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.713829 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.713789 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzvv\" (UniqueName: \"kubernetes.io/projected/45b5735c-7b24-4029-a4a7-ef51191f5985-kube-api-access-hhzvv\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:45.713829 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.713817 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:45.714091 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.713838 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/864ff596-a523-4c11-a9bf-f0f15940074f-config-volume\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.714091 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.713871 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5n7x\" (UniqueName: \"kubernetes.io/projected/864ff596-a523-4c11-a9bf-f0f15940074f-kube-api-access-v5n7x\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.714091 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.713888 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.714091 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:45.713965 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:45.714091 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:45.713992 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:45.714091 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:45.714039 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:46.214018827 +0000 UTC m=+35.058645822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:23:45.714091 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:45.714059 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:23:46.214050055 +0000 UTC m=+35.058677053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:23:45.714451 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.714131 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/864ff596-a523-4c11-a9bf-f0f15940074f-tmp-dir\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.714529 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.714451 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/864ff596-a523-4c11-a9bf-f0f15940074f-config-volume\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.728748 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.728722 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5n7x\" (UniqueName: \"kubernetes.io/projected/864ff596-a523-4c11-a9bf-f0f15940074f-kube-api-access-v5n7x\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:45.728925 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.728903 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzvv\" (UniqueName: \"kubernetes.io/projected/45b5735c-7b24-4029-a4a7-ef51191f5985-kube-api-access-hhzvv\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:45.753170 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.753128 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:23:45.753343 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.753323 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:23:45.759766 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.759743 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 31 17:23:45.759961 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.759766 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 31 17:23:45.760091 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.760062 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rdvr2\"" May 31 17:23:45.760175 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.760113 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 31 17:23:45.760315 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:45.760298 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrg\"" May 31 17:23:46.219009 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:46.218973 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:46.219184 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:46.219039 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:46.219184 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:46.219139 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:46.219184 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:46.219147 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:46.219294 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:46.219221 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:23:47.219203661 +0000 UTC m=+36.063830654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:23:46.219294 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:46.219236 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:47.219229972 +0000 UTC m=+36.063856964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:23:47.225710 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:47.225673 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:47.226319 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:47.225739 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:47.226319 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:47.225829 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:47.226319 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:47.225829 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:47.226319 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:47.225887 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:49.225870321 +0000 UTC m=+38.070497334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:23:47.226319 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:47.225901 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:23:49.225895228 +0000 UTC m=+38.070522221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:23:47.983957 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:47.983924 2569 generic.go:358] "Generic (PLEG): container finished" podID="548ef623-526e-4b47-a497-22ecfea7a2df" containerID="d87adec0e822c28930f03330903f34df3e607ec7971933bdc932957858c5a3fe" exitCode=0 May 31 17:23:47.984097 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:47.983982 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" event={"ID":"548ef623-526e-4b47-a497-22ecfea7a2df","Type":"ContainerDied","Data":"d87adec0e822c28930f03330903f34df3e607ec7971933bdc932957858c5a3fe"} May 31 17:23:48.988860 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:48.988819 2569 generic.go:358] "Generic (PLEG): container finished" podID="548ef623-526e-4b47-a497-22ecfea7a2df" containerID="e8c0791851bd4b89594c6bb19b17bf12fbfedc0f2b818bf7e0a247a04d34180c" exitCode=0 May 31 17:23:48.989331 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:48.988868 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" event={"ID":"548ef623-526e-4b47-a497-22ecfea7a2df","Type":"ContainerDied","Data":"e8c0791851bd4b89594c6bb19b17bf12fbfedc0f2b818bf7e0a247a04d34180c"} May 31 17:23:49.239404 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:49.239312 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:49.239404 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:49.239391 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:49.239603 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:49.239466 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:49.239603 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:49.239467 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:49.239603 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:49.239549 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:23:53.239529335 +0000 UTC m=+42.084156342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:23:49.239603 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:49.239564 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:53.239558103 +0000 UTC m=+42.084185096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:23:49.993716 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:49.993675 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" event={"ID":"548ef623-526e-4b47-a497-22ecfea7a2df","Type":"ContainerStarted","Data":"752ec08acec7e276e57c1c6c6418a9fe644cfb4bad493dc5a9a622b323d7dc03"} May 31 17:23:50.029292 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:50.029231 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4qrjg" podStartSLOduration=5.200765931 podStartE2EDuration="39.029212847s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.033083771 +0000 UTC m=+1.877710764" lastFinishedPulling="2026-05-31 17:23:46.861530684 +0000 UTC m=+35.706157680" observedRunningTime="2026-05-31 17:23:50.026640539 +0000 UTC m=+38.871267554" watchObservedRunningTime="2026-05-31 17:23:50.029212847 +0000 UTC m=+38.873839862" May 31 17:23:53.266484 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:53.266293 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:23:53.266878 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:23:53.266539 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:23:53.266878 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:53.266429 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:53.266878 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:53.266581 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:53.266878 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:53.266609 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:24:01.26659601 +0000 UTC m=+50.111223003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:23:53.266878 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:23:53.266628 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:24:01.26661617 +0000 UTC m=+50.111243163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:24:01.318808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:01.318758 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:24:01.319342 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:01.318839 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:24:01.319342 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:01.318915 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:24:01.319342 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:01.318957 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:24:01.319342 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:01.318982 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:24:17.318966454 +0000 UTC m=+66.163593447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:24:01.319342 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:01.319010 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:24:17.31899353 +0000 UTC m=+66.163620523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:24:09.979220 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:09.979192 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6jfx" May 31 17:24:16.424062 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.424017 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:24:16.427226 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.427210 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 31 17:24:16.434422 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:16.434398 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 31 17:24:16.434528 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:16.434474 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:20.434450918 +0000 UTC m=+129.279077929 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : secret "metrics-daemon-secret" not found May 31 17:24:16.525111 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.525075 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:24:16.528394 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.528377 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 31 17:24:16.538867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.538840 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 31 17:24:16.549230 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.549205 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxc6\" (UniqueName: \"kubernetes.io/projected/03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96-kube-api-access-2cxc6\") pod \"network-check-target-7f4sn\" (UID: \"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96\") " pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:24:16.675158 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.675071 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rdvr2\"" May 31 17:24:16.682566 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.682543 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:24:16.856641 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:16.856574 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7f4sn"] May 31 17:24:16.860924 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:24:16.860895 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a9ae7b_b6f1_4a7b_b57d_9afa687d6f96.slice/crio-78a398df2177311a02df73e4a9d6868f4c0c7ce34a6fc7c3968070bcffb3a212 WatchSource:0}: Error finding container 78a398df2177311a02df73e4a9d6868f4c0c7ce34a6fc7c3968070bcffb3a212: Status 404 returned error can't find the container with id 78a398df2177311a02df73e4a9d6868f4c0c7ce34a6fc7c3968070bcffb3a212 May 31 17:24:17.041989 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:17.041907 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7f4sn" event={"ID":"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96","Type":"ContainerStarted","Data":"78a398df2177311a02df73e4a9d6868f4c0c7ce34a6fc7c3968070bcffb3a212"} May 31 17:24:17.333176 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:17.333141 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:24:17.333324 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:17.333192 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:24:17.333324 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:17.333289 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:24:17.333324 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:17.333289 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:24:17.333422 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:17.333343 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:24:49.333329532 +0000 UTC m=+98.177956525 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:24:17.333422 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:17.333356 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:24:49.333350423 +0000 UTC m=+98.177977416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:24:20.048815 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:20.048727 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7f4sn" event={"ID":"03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96","Type":"ContainerStarted","Data":"a58a1ff1196ae8e6d192a4798da1715163da53ba04d71b38270a9912848ca721"} May 31 17:24:20.049156 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:20.048855 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:24:20.088730 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:20.088675 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7f4sn" podStartSLOduration=65.24703448 podStartE2EDuration="1m8.088661967s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="2026-05-31 17:24:16.862345285 +0000 UTC m=+65.706972278" lastFinishedPulling="2026-05-31 17:24:19.703972755 +0000 UTC m=+68.548599765" observedRunningTime="2026-05-31 17:24:20.087604347 +0000 UTC m=+68.932231362" watchObservedRunningTime="2026-05-31 17:24:20.088661967 +0000 UTC m=+68.933289029" May 31 17:24:49.352718 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:49.352664 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:24:49.353196 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:49.352742 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:24:49.353196 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:49.352830 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:24:49.353196 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:49.352830 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:24:49.353196 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:49.352913 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:25:53.352893812 +0000 UTC m=+162.197520807 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:24:49.353196 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:24:49.352929 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:53.352922943 +0000 UTC m=+162.197549936 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:24:51.053267 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:24:51.053227 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7f4sn" May 31 17:25:20.464309 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:20.464256 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:25:20.464827 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:20.464402 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 31 17:25:20.464827 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:20.464472 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs podName:829a36da-0012-4624-8443-6808a574c032 nodeName:}" failed. No retries permitted until 2026-05-31 17:27:22.464455626 +0000 UTC m=+251.309082619 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs") pod "network-metrics-daemon-kfgfg" (UID: "829a36da-0012-4624-8443-6808a574c032") : secret "metrics-daemon-secret" not found May 31 17:25:33.496281 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.496250 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-cnzn9"] May 31 17:25:33.498989 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.498972 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.503705 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.503672 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 31 17:25:33.504026 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.504005 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 31 17:25:33.504157 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.504061 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sgqh4\"" May 31 17:25:33.505299 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.504944 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 31 17:25:33.505299 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.505048 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 31 17:25:33.511352 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.511333 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 31 17:25:33.519873 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.519851 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-cnzn9"] May 31 17:25:33.555860 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.555820 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.555860 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.555857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-tmp\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.556061 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.555879 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-serving-cert\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.556061 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.555936 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-service-ca-bundle\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.556061 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.556007 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-snapshots\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.556061 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.556038 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhf9k\" (UniqueName: \"kubernetes.io/projected/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-kube-api-access-lhf9k\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.656577 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.656544 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhf9k\" (UniqueName: \"kubernetes.io/projected/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-kube-api-access-lhf9k\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.656738 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.656595 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.656738 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.656618 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-tmp\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.656738 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.656653 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-serving-cert\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.656738 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.656679 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-service-ca-bundle\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.656920 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.656789 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-snapshots\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.657083 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.657064 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-tmp\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.657380 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.657362 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-snapshots\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.657426 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.657377 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-service-ca-bundle\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.657742 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.657534 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.661446 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.661420 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-serving-cert\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.665801 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.665778 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhf9k\" (UniqueName: \"kubernetes.io/projected/20c8f248-6378-4f89-b3a6-d4a34b6a9b47-kube-api-access-lhf9k\") pod \"insights-operator-788bf58df5-cnzn9\" (UID: \"20c8f248-6378-4f89-b3a6-d4a34b6a9b47\") " pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.807664 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.807564 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-cnzn9" May 31 17:25:33.929103 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:33.929069 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-cnzn9"] May 31 17:25:33.932104 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:25:33.932075 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c8f248_6378_4f89_b3a6_d4a34b6a9b47.slice/crio-302cf668fc739c3f5ab6f69301af27eea013c39f1ff03a30b4e1c6d5f023bbc9 WatchSource:0}: Error finding container 302cf668fc739c3f5ab6f69301af27eea013c39f1ff03a30b4e1c6d5f023bbc9: Status 404 returned error can't find the container with id 302cf668fc739c3f5ab6f69301af27eea013c39f1ff03a30b4e1c6d5f023bbc9 May 31 17:25:34.189251 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:34.189203 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-cnzn9" event={"ID":"20c8f248-6378-4f89-b3a6-d4a34b6a9b47","Type":"ContainerStarted","Data":"302cf668fc739c3f5ab6f69301af27eea013c39f1ff03a30b4e1c6d5f023bbc9"} May 31 17:25:36.194845 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.194807 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-cnzn9" event={"ID":"20c8f248-6378-4f89-b3a6-d4a34b6a9b47","Type":"ContainerStarted","Data":"aa0c766c7159cb76479a06ebe0c75851fd5d41977ba38091e4ff59ce613fd32a"} May 31 17:25:36.212984 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.212933 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-cnzn9" podStartSLOduration=1.166491765 podStartE2EDuration="3.212920125s" podCreationTimestamp="2026-05-31 17:25:33 +0000 UTC" firstStartedPulling="2026-05-31 17:25:33.933866601 +0000 UTC m=+142.778493594" lastFinishedPulling="2026-05-31 17:25:35.980294961 +0000 UTC m=+144.824921954" observedRunningTime="2026-05-31 17:25:36.211371943 +0000 UTC m=+145.055998958" watchObservedRunningTime="2026-05-31 17:25:36.212920125 +0000 UTC m=+145.057547139" May 31 17:25:36.554191 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.554150 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg"] May 31 17:25:36.557242 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.557222 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg" May 31 17:25:36.559851 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.559827 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 31 17:25:36.560204 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.560184 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 31 17:25:36.560204 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.560192 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-q954w\"" May 31 17:25:36.565316 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.565291 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg"] May 31 17:25:36.678451 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.678405 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlcsb\" (UniqueName: \"kubernetes.io/projected/cdecb433-ade7-41c2-ab3f-84cbf8d8e023-kube-api-access-dlcsb\") pod \"volume-data-source-validator-7598fd5bd-vkjfg\" (UID: \"cdecb433-ade7-41c2-ab3f-84cbf8d8e023\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg" May 31 17:25:36.779359 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.779317 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcsb\" (UniqueName: \"kubernetes.io/projected/cdecb433-ade7-41c2-ab3f-84cbf8d8e023-kube-api-access-dlcsb\") pod \"volume-data-source-validator-7598fd5bd-vkjfg\" (UID: \"cdecb433-ade7-41c2-ab3f-84cbf8d8e023\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg" May 31 17:25:36.789800 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.789769 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlcsb\" (UniqueName: \"kubernetes.io/projected/cdecb433-ade7-41c2-ab3f-84cbf8d8e023-kube-api-access-dlcsb\") pod \"volume-data-source-validator-7598fd5bd-vkjfg\" (UID: \"cdecb433-ade7-41c2-ab3f-84cbf8d8e023\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg" May 31 17:25:36.867219 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.867185 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg" May 31 17:25:36.994366 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:36.994336 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg"] May 31 17:25:36.998367 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:25:36.998335 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdecb433_ade7_41c2_ab3f_84cbf8d8e023.slice/crio-f09adfd31a94162aa931f7647dde790a46c28a2aa9e25d5e5c63f30e4ed505a5 WatchSource:0}: Error finding container f09adfd31a94162aa931f7647dde790a46c28a2aa9e25d5e5c63f30e4ed505a5: Status 404 returned error can't find the container with id f09adfd31a94162aa931f7647dde790a46c28a2aa9e25d5e5c63f30e4ed505a5 May 31 17:25:37.198354 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.198270 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg" event={"ID":"cdecb433-ade7-41c2-ab3f-84cbf8d8e023","Type":"ContainerStarted","Data":"f09adfd31a94162aa931f7647dde790a46c28a2aa9e25d5e5c63f30e4ed505a5"} May 31 17:25:37.521046 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.520949 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-qkn6w"] May 31 17:25:37.523823 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.523800 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.526743 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.526721 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dx9tv\"" May 31 17:25:37.529102 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.528673 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 31 17:25:37.529222 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.529161 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 31 17:25:37.532875 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.529852 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 31 17:25:37.532875 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.530090 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 31 17:25:37.534757 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.534738 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 31 17:25:37.547475 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.547443 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-qkn6w"] May 31 17:25:37.585703 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.585660 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s46b\" (UniqueName: \"kubernetes.io/projected/995ded47-c9c0-4571-9f75-9879ed966dc0-kube-api-access-4s46b\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.585884 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.585727 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/995ded47-c9c0-4571-9f75-9879ed966dc0-trusted-ca\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.585884 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.585850 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/995ded47-c9c0-4571-9f75-9879ed966dc0-config\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.585987 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.585899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/995ded47-c9c0-4571-9f75-9879ed966dc0-serving-cert\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.687169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.687130 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/995ded47-c9c0-4571-9f75-9879ed966dc0-serving-cert\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.687342 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.687177 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s46b\" (UniqueName: \"kubernetes.io/projected/995ded47-c9c0-4571-9f75-9879ed966dc0-kube-api-access-4s46b\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.687342 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.687210 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/995ded47-c9c0-4571-9f75-9879ed966dc0-trusted-ca\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.687342 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.687247 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/995ded47-c9c0-4571-9f75-9879ed966dc0-config\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.688071 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.688040 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/995ded47-c9c0-4571-9f75-9879ed966dc0-config\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.688216 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.688198 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/995ded47-c9c0-4571-9f75-9879ed966dc0-trusted-ca\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.689601 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.689576 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/995ded47-c9c0-4571-9f75-9879ed966dc0-serving-cert\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.696432 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.696405 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s46b\" (UniqueName: \"kubernetes.io/projected/995ded47-c9c0-4571-9f75-9879ed966dc0-kube-api-access-4s46b\") pod \"console-operator-86d7c6cc77-qkn6w\" (UID: \"995ded47-c9c0-4571-9f75-9879ed966dc0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.837874 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.837827 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:37.971551 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:37.971517 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-qkn6w"] May 31 17:25:37.975630 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:25:37.975602 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995ded47_c9c0_4571_9f75_9879ed966dc0.slice/crio-22d79e2a4f73c87057c67e47f729efa06bb56c5a6f8562a527b88baf8509ef26 WatchSource:0}: Error finding container 22d79e2a4f73c87057c67e47f729efa06bb56c5a6f8562a527b88baf8509ef26: Status 404 returned error can't find the container with id 22d79e2a4f73c87057c67e47f729efa06bb56c5a6f8562a527b88baf8509ef26 May 31 17:25:38.201962 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:38.201870 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" event={"ID":"995ded47-c9c0-4571-9f75-9879ed966dc0","Type":"ContainerStarted","Data":"22d79e2a4f73c87057c67e47f729efa06bb56c5a6f8562a527b88baf8509ef26"} May 31 17:25:38.891630 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:38.891600 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-27xb9_3bc6e587-62f0-4943-ad56-66ac1707325e/dns-node-resolver/0.log" May 31 17:25:39.205090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:39.204992 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg" event={"ID":"cdecb433-ade7-41c2-ab3f-84cbf8d8e023","Type":"ContainerStarted","Data":"a071b6e440d1da46a3e127e9b1c15ffc1d6ec9dfed13a59c6f10da084450d959"} May 31 17:25:39.221598 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:39.221535 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-vkjfg" podStartSLOduration=1.7798274219999999 podStartE2EDuration="3.221516545s" podCreationTimestamp="2026-05-31 17:25:36 +0000 UTC" firstStartedPulling="2026-05-31 17:25:37.000324335 +0000 UTC m=+145.844951346" lastFinishedPulling="2026-05-31 17:25:38.442013476 +0000 UTC m=+147.286640469" observedRunningTime="2026-05-31 17:25:39.220514594 +0000 UTC m=+148.065141606" watchObservedRunningTime="2026-05-31 17:25:39.221516545 +0000 UTC m=+148.066143562" May 31 17:25:39.691766 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:39.691734 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f5jtz_3076a993-9118-4289-8f14-a8e9349d37d0/node-ca/0.log" May 31 17:25:40.208676 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:40.208592 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/0.log" May 31 17:25:40.208676 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:40.208639 2569 generic.go:358] "Generic (PLEG): container finished" podID="995ded47-c9c0-4571-9f75-9879ed966dc0" containerID="627feec729b9e7ba575e061bcf81292bc53ab8183c2ec1aee3dbad208e777fbb" exitCode=255 May 31 17:25:40.209050 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:40.208671 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" event={"ID":"995ded47-c9c0-4571-9f75-9879ed966dc0","Type":"ContainerDied","Data":"627feec729b9e7ba575e061bcf81292bc53ab8183c2ec1aee3dbad208e777fbb"} May 31 17:25:40.209050 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:40.208887 2569 scope.go:117] "RemoveContainer" containerID="627feec729b9e7ba575e061bcf81292bc53ab8183c2ec1aee3dbad208e777fbb" May 31 17:25:41.215617 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.215581 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/1.log" May 31 17:25:41.216016 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.215975 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/0.log" May 31 17:25:41.216076 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.216010 2569 generic.go:358] "Generic (PLEG): container finished" podID="995ded47-c9c0-4571-9f75-9879ed966dc0" containerID="c1ba5577163aa57f7731ee4b87db1e0b8cb3280debe298e18bb5e41a1288d295" exitCode=255 May 31 17:25:41.216131 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.216097 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" event={"ID":"995ded47-c9c0-4571-9f75-9879ed966dc0","Type":"ContainerDied","Data":"c1ba5577163aa57f7731ee4b87db1e0b8cb3280debe298e18bb5e41a1288d295"} May 31 17:25:41.216182 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.216142 2569 scope.go:117] "RemoveContainer" containerID="627feec729b9e7ba575e061bcf81292bc53ab8183c2ec1aee3dbad208e777fbb" May 31 17:25:41.216358 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.216341 2569 scope.go:117] "RemoveContainer" containerID="c1ba5577163aa57f7731ee4b87db1e0b8cb3280debe298e18bb5e41a1288d295" May 31 17:25:41.216565 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:41.216545 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-qkn6w_openshift-console-operator(995ded47-c9c0-4571-9f75-9879ed966dc0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" podUID="995ded47-c9c0-4571-9f75-9879ed966dc0" May 31 17:25:41.518702 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.518620 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn"] May 31 17:25:41.522469 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.522452 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.525189 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.525164 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 31 17:25:41.525437 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.525391 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 31 17:25:41.525437 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.525403 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-q8v26\"" May 31 17:25:41.525437 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.525398 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 31 17:25:41.527193 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.527171 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 31 17:25:41.533292 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.533269 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn"] May 31 17:25:41.617514 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.617444 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f35ff586-dd68-442e-96d8-fefaae59c84b-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.617754 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.617597 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f35ff586-dd68-442e-96d8-fefaae59c84b-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.617754 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.617648 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ngq4\" (UniqueName: \"kubernetes.io/projected/f35ff586-dd68-442e-96d8-fefaae59c84b-kube-api-access-7ngq4\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.718617 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.718578 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f35ff586-dd68-442e-96d8-fefaae59c84b-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.718795 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.718638 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f35ff586-dd68-442e-96d8-fefaae59c84b-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.718795 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.718665 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ngq4\" (UniqueName: \"kubernetes.io/projected/f35ff586-dd68-442e-96d8-fefaae59c84b-kube-api-access-7ngq4\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.719184 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.719163 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f35ff586-dd68-442e-96d8-fefaae59c84b-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.720963 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.720937 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f35ff586-dd68-442e-96d8-fefaae59c84b-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.726865 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.726837 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ngq4\" (UniqueName: \"kubernetes.io/projected/f35ff586-dd68-442e-96d8-fefaae59c84b-kube-api-access-7ngq4\") pod \"kube-storage-version-migrator-operator-96ddc787c-rfrpn\" (UID: \"f35ff586-dd68-442e-96d8-fefaae59c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.831464 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.831430 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" May 31 17:25:41.957990 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:41.957955 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn"] May 31 17:25:41.962580 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:25:41.962545 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35ff586_dd68_442e_96d8_fefaae59c84b.slice/crio-1e399e6573bebec9ad82d563daef1e7dd1d021b1e81f589c8358c912b55d681e WatchSource:0}: Error finding container 1e399e6573bebec9ad82d563daef1e7dd1d021b1e81f589c8358c912b55d681e: Status 404 returned error can't find the container with id 1e399e6573bebec9ad82d563daef1e7dd1d021b1e81f589c8358c912b55d681e May 31 17:25:42.219674 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:42.219573 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" event={"ID":"f35ff586-dd68-442e-96d8-fefaae59c84b","Type":"ContainerStarted","Data":"1e399e6573bebec9ad82d563daef1e7dd1d021b1e81f589c8358c912b55d681e"} May 31 17:25:42.220789 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:42.220772 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/1.log" May 31 17:25:42.221113 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:42.221094 2569 scope.go:117] "RemoveContainer" containerID="c1ba5577163aa57f7731ee4b87db1e0b8cb3280debe298e18bb5e41a1288d295" May 31 17:25:42.221314 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:42.221295 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-qkn6w_openshift-console-operator(995ded47-c9c0-4571-9f75-9879ed966dc0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" podUID="995ded47-c9c0-4571-9f75-9879ed966dc0" May 31 17:25:43.531203 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.531168 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-s8k66"] May 31 17:25:43.534193 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.534170 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.537402 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.537378 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 31 17:25:43.537817 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.537778 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 31 17:25:43.537950 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.537783 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 31 17:25:43.538657 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.538632 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nh56v\"" May 31 17:25:43.538740 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.538690 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 31 17:25:43.553613 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.553580 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-s8k66"] May 31 17:25:43.633962 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.633926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-config\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.634126 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.633999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-serving-cert\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.634126 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.634081 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqfqt\" (UniqueName: \"kubernetes.io/projected/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-kube-api-access-pqfqt\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.735431 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.735390 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqfqt\" (UniqueName: \"kubernetes.io/projected/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-kube-api-access-pqfqt\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.735638 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.735447 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-config\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.735711 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.735683 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-serving-cert\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.736057 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.736022 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-config\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.738337 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.738311 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-serving-cert\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.744845 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.744822 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqfqt\" (UniqueName: \"kubernetes.io/projected/1cbe028c-006e-4344-b8ef-6feb3cc6cb88-kube-api-access-pqfqt\") pod \"service-ca-operator-69877444c-s8k66\" (UID: \"1cbe028c-006e-4344-b8ef-6feb3cc6cb88\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.844880 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.844839 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" May 31 17:25:43.909305 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.909267 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq"] May 31 17:25:43.913608 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.913572 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq" May 31 17:25:43.916205 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.916179 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-86rz8\"" May 31 17:25:43.920063 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:43.920016 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq"] May 31 17:25:44.039250 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.039214 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtljd\" (UniqueName: \"kubernetes.io/projected/dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01-kube-api-access-xtljd\") pod \"network-check-source-56d84b9f44-5q5hq\" (UID: \"dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq" May 31 17:25:44.121485 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.121454 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-s8k66"] May 31 17:25:44.125981 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:25:44.125948 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbe028c_006e_4344_b8ef_6feb3cc6cb88.slice/crio-38cd362ce0c9921a9652d15b98070ffd95101fa0408d6a000584ee55a648fe29 WatchSource:0}: Error finding container 38cd362ce0c9921a9652d15b98070ffd95101fa0408d6a000584ee55a648fe29: Status 404 returned error can't find the container with id 38cd362ce0c9921a9652d15b98070ffd95101fa0408d6a000584ee55a648fe29 May 31 17:25:44.139793 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.139763 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtljd\" (UniqueName: \"kubernetes.io/projected/dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01-kube-api-access-xtljd\") pod \"network-check-source-56d84b9f44-5q5hq\" (UID: \"dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq" May 31 17:25:44.149223 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.149184 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtljd\" (UniqueName: \"kubernetes.io/projected/dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01-kube-api-access-xtljd\") pod \"network-check-source-56d84b9f44-5q5hq\" (UID: \"dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq" May 31 17:25:44.226267 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.226233 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq" May 31 17:25:44.228308 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.228274 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" event={"ID":"f35ff586-dd68-442e-96d8-fefaae59c84b","Type":"ContainerStarted","Data":"93b7c10e3c5c7777ace9257c9c6c4271b948e91a55655fc65f19961ed3c4e4bf"} May 31 17:25:44.229330 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.229302 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" event={"ID":"1cbe028c-006e-4344-b8ef-6feb3cc6cb88","Type":"ContainerStarted","Data":"38cd362ce0c9921a9652d15b98070ffd95101fa0408d6a000584ee55a648fe29"} May 31 17:25:44.246325 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.246263 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" podStartSLOduration=1.1653723280000001 podStartE2EDuration="3.246243511s" podCreationTimestamp="2026-05-31 17:25:41 +0000 UTC" firstStartedPulling="2026-05-31 17:25:41.964366923 +0000 UTC m=+150.808993917" lastFinishedPulling="2026-05-31 17:25:44.045238093 +0000 UTC m=+152.889865100" observedRunningTime="2026-05-31 17:25:44.244831441 +0000 UTC m=+153.089458456" watchObservedRunningTime="2026-05-31 17:25:44.246243511 +0000 UTC m=+153.090870528" May 31 17:25:44.359117 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:44.359041 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq"] May 31 17:25:44.361890 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:25:44.361857 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8ced61_a72e_4b70_bb32_9dfb7e8b1f01.slice/crio-ad2128dca165591a8cdc37d6b21fabcb2b7b4a3ab0661cf505c2acdaee5d5d06 WatchSource:0}: Error finding container ad2128dca165591a8cdc37d6b21fabcb2b7b4a3ab0661cf505c2acdaee5d5d06: Status 404 returned error can't find the container with id ad2128dca165591a8cdc37d6b21fabcb2b7b4a3ab0661cf505c2acdaee5d5d06 May 31 17:25:45.233915 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:45.233869 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq" event={"ID":"dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01","Type":"ContainerStarted","Data":"f31900fe6d79ef9750db00b7c7ff8c186957ee1caf14ca376c2152531c2546b4"} May 31 17:25:45.233915 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:45.233918 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq" event={"ID":"dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01","Type":"ContainerStarted","Data":"ad2128dca165591a8cdc37d6b21fabcb2b7b4a3ab0661cf505c2acdaee5d5d06"} May 31 17:25:45.252311 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:45.252258 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5q5hq" podStartSLOduration=2.252242349 podStartE2EDuration="2.252242349s" podCreationTimestamp="2026-05-31 17:25:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:25:45.250924207 +0000 UTC m=+154.095551224" watchObservedRunningTime="2026-05-31 17:25:45.252242349 +0000 UTC m=+154.096869358" May 31 17:25:47.240783 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:47.240744 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" event={"ID":"1cbe028c-006e-4344-b8ef-6feb3cc6cb88","Type":"ContainerStarted","Data":"7a73705eb794a4846d8e6accdb93eae37419cfdf900f1fed4b9c9c15b2d7e54b"} May 31 17:25:47.261703 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:47.261651 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" podStartSLOduration=2.123829678 podStartE2EDuration="4.261637077s" podCreationTimestamp="2026-05-31 17:25:43 +0000 UTC" firstStartedPulling="2026-05-31 17:25:44.127870414 +0000 UTC m=+152.972497407" lastFinishedPulling="2026-05-31 17:25:46.265677812 +0000 UTC m=+155.110304806" observedRunningTime="2026-05-31 17:25:47.260136746 +0000 UTC m=+156.104763761" watchObservedRunningTime="2026-05-31 17:25:47.261637077 +0000 UTC m=+156.106264091" May 31 17:25:47.838914 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:47.838867 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:47.838914 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:47.838916 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:25:47.839345 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:47.839326 2569 scope.go:117] "RemoveContainer" containerID="c1ba5577163aa57f7731ee4b87db1e0b8cb3280debe298e18bb5e41a1288d295" May 31 17:25:47.839576 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:47.839556 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-qkn6w_openshift-console-operator(995ded47-c9c0-4571-9f75-9879ed966dc0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" podUID="995ded47-c9c0-4571-9f75-9879ed966dc0" May 31 17:25:48.540421 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:48.540379 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zmkvc" podUID="864ff596-a523-4c11-a9bf-f0f15940074f" May 31 17:25:48.559577 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:48.559524 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-9kf44" podUID="45b5735c-7b24-4029-a4a7-ef51191f5985" May 31 17:25:48.765824 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:48.765766 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kfgfg" podUID="829a36da-0012-4624-8443-6808a574c032" May 31 17:25:49.245010 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:49.244969 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:25:49.245166 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:49.245048 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmkvc" May 31 17:25:50.538781 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.538745 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6j8"] May 31 17:25:50.542139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.542118 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.544447 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.544426 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 31 17:25:50.544592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.544557 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dn54w\"" May 31 17:25:50.544717 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.544700 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 31 17:25:50.554148 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.554125 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6j8"] May 31 17:25:50.589101 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.589060 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-dnf87"] May 31 17:25:50.592062 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.592045 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.594712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.594688 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 31 17:25:50.594832 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.594729 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 31 17:25:50.594832 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.594768 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 31 17:25:50.594924 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.594862 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 31 17:25:50.594962 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.594943 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-246xf\"" May 31 17:25:50.599988 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.599965 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-dnf87"] May 31 17:25:50.694592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.694546 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.694786 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.694601 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07d5b085-594c-4352-b03c-a8a558dd2904-data-volume\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.694786 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.694668 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnnvc\" (UniqueName: \"kubernetes.io/projected/07d5b085-594c-4352-b03c-a8a558dd2904-kube-api-access-jnnvc\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.694786 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.694732 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8a5ffc44-ccec-4a5f-af36-3c049accc429-signing-key\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.694786 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.694768 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07d5b085-594c-4352-b03c-a8a558dd2904-crio-socket\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.694786 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.694786 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07d5b085-594c-4352-b03c-a8a558dd2904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.694957 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.694803 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zlq\" (UniqueName: \"kubernetes.io/projected/8a5ffc44-ccec-4a5f-af36-3c049accc429-kube-api-access-49zlq\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.694957 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.694821 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8a5ffc44-ccec-4a5f-af36-3c049accc429-signing-cabundle\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.795439 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795345 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8a5ffc44-ccec-4a5f-af36-3c049accc429-signing-key\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.795439 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795393 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07d5b085-594c-4352-b03c-a8a558dd2904-crio-socket\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.795439 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795420 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07d5b085-594c-4352-b03c-a8a558dd2904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.795439 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795437 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49zlq\" (UniqueName: \"kubernetes.io/projected/8a5ffc44-ccec-4a5f-af36-3c049accc429-kube-api-access-49zlq\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.795768 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795456 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8a5ffc44-ccec-4a5f-af36-3c049accc429-signing-cabundle\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.795768 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795486 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.795768 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795545 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07d5b085-594c-4352-b03c-a8a558dd2904-data-volume\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.795768 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795579 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnnvc\" (UniqueName: \"kubernetes.io/projected/07d5b085-594c-4352-b03c-a8a558dd2904-kube-api-access-jnnvc\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.795768 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795600 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07d5b085-594c-4352-b03c-a8a558dd2904-crio-socket\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.795768 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:50.795674 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 31 17:25:50.795768 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:50.795761 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls podName:07d5b085-594c-4352-b03c-a8a558dd2904 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:51.295739019 +0000 UTC m=+160.140366026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6j8" (UID: "07d5b085-594c-4352-b03c-a8a558dd2904") : secret "insights-runtime-extractor-tls" not found May 31 17:25:50.796070 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.795946 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07d5b085-594c-4352-b03c-a8a558dd2904-data-volume\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.796136 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.796118 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07d5b085-594c-4352-b03c-a8a558dd2904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.796204 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.796179 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8a5ffc44-ccec-4a5f-af36-3c049accc429-signing-cabundle\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.797928 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.797910 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8a5ffc44-ccec-4a5f-af36-3c049accc429-signing-key\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.811391 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.811360 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnnvc\" (UniqueName: \"kubernetes.io/projected/07d5b085-594c-4352-b03c-a8a558dd2904-kube-api-access-jnnvc\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:50.811544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.811523 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zlq\" (UniqueName: \"kubernetes.io/projected/8a5ffc44-ccec-4a5f-af36-3c049accc429-kube-api-access-49zlq\") pod \"service-ca-685df94d57-dnf87\" (UID: \"8a5ffc44-ccec-4a5f-af36-3c049accc429\") " pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:50.901413 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:50.901369 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-dnf87" May 31 17:25:51.029666 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:51.029625 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-dnf87"] May 31 17:25:51.032994 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:25:51.032967 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5ffc44_ccec_4a5f_af36_3c049accc429.slice/crio-a7d095cc4b01b4dc3f3f11de777cf3f98d5b4d538c040576f480c526bed2c5d4 WatchSource:0}: Error finding container a7d095cc4b01b4dc3f3f11de777cf3f98d5b4d538c040576f480c526bed2c5d4: Status 404 returned error can't find the container with id a7d095cc4b01b4dc3f3f11de777cf3f98d5b4d538c040576f480c526bed2c5d4 May 31 17:25:51.251792 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:51.251753 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-dnf87" event={"ID":"8a5ffc44-ccec-4a5f-af36-3c049accc429","Type":"ContainerStarted","Data":"45e269965f835132ff360f20659af084fb2c735fcb55acadaa98f13f14ec6971"} May 31 17:25:51.251792 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:51.251789 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-dnf87" event={"ID":"8a5ffc44-ccec-4a5f-af36-3c049accc429","Type":"ContainerStarted","Data":"a7d095cc4b01b4dc3f3f11de777cf3f98d5b4d538c040576f480c526bed2c5d4"} May 31 17:25:51.274672 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:51.274621 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-dnf87" podStartSLOduration=1.274607061 podStartE2EDuration="1.274607061s" podCreationTimestamp="2026-05-31 17:25:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:25:51.274025131 +0000 UTC m=+160.118652146" watchObservedRunningTime="2026-05-31 17:25:51.274607061 +0000 UTC m=+160.119234162" May 31 17:25:51.299353 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:51.299308 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:51.299478 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:51.299414 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 31 17:25:51.299562 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:51.299480 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls podName:07d5b085-594c-4352-b03c-a8a558dd2904 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:52.299467241 +0000 UTC m=+161.144094235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6j8" (UID: "07d5b085-594c-4352-b03c-a8a558dd2904") : secret "insights-runtime-extractor-tls" not found May 31 17:25:52.307972 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:52.307920 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:52.308425 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:52.308101 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 31 17:25:52.308425 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:52.308181 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls podName:07d5b085-594c-4352-b03c-a8a558dd2904 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:54.308159838 +0000 UTC m=+163.152786836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6j8" (UID: "07d5b085-594c-4352-b03c-a8a558dd2904") : secret "insights-runtime-extractor-tls" not found May 31 17:25:53.417791 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:53.417745 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:25:53.418181 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:53.417809 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:25:53.418181 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:53.417916 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:25:53.418181 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:53.417981 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls podName:864ff596-a523-4c11-a9bf-f0f15940074f nodeName:}" failed. No retries permitted until 2026-05-31 17:27:55.417967029 +0000 UTC m=+284.262594022 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls") pod "dns-default-zmkvc" (UID: "864ff596-a523-4c11-a9bf-f0f15940074f") : secret "dns-default-metrics-tls" not found May 31 17:25:53.418181 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:53.417920 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:25:53.418181 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:53.418052 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert podName:45b5735c-7b24-4029-a4a7-ef51191f5985 nodeName:}" failed. No retries permitted until 2026-05-31 17:27:55.418041016 +0000 UTC m=+284.262668009 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert") pod "ingress-canary-9kf44" (UID: "45b5735c-7b24-4029-a4a7-ef51191f5985") : secret "canary-serving-cert" not found May 31 17:25:54.325116 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:54.325077 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:54.325367 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:54.325249 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 31 17:25:54.325410 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:25:54.325384 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls podName:07d5b085-594c-4352-b03c-a8a558dd2904 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:58.325362118 +0000 UTC m=+167.169989117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6j8" (UID: "07d5b085-594c-4352-b03c-a8a558dd2904") : secret "insights-runtime-extractor-tls" not found May 31 17:25:58.361114 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:58.361056 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:58.363814 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:58.363775 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07d5b085-594c-4352-b03c-a8a558dd2904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6j8\" (UID: \"07d5b085-594c-4352-b03c-a8a558dd2904\") " pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:58.651276 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:58.651187 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qb6j8" May 31 17:25:58.782411 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:58.782372 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6j8"] May 31 17:25:58.785442 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:25:58.785411 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d5b085_594c_4352_b03c_a8a558dd2904.slice/crio-2e7ca3c71094989c940d09fcef10779250ba766073c2ae73c0763a6f84189237 WatchSource:0}: Error finding container 2e7ca3c71094989c940d09fcef10779250ba766073c2ae73c0763a6f84189237: Status 404 returned error can't find the container with id 2e7ca3c71094989c940d09fcef10779250ba766073c2ae73c0763a6f84189237 May 31 17:25:59.276055 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:59.276019 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6j8" event={"ID":"07d5b085-594c-4352-b03c-a8a558dd2904","Type":"ContainerStarted","Data":"15d28f6ffd84908441b748ca9f8231badad0f47dbcb94e20ab4156bf15b49010"} May 31 17:25:59.276055 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:25:59.276058 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6j8" event={"ID":"07d5b085-594c-4352-b03c-a8a558dd2904","Type":"ContainerStarted","Data":"2e7ca3c71094989c940d09fcef10779250ba766073c2ae73c0763a6f84189237"} May 31 17:26:00.280427 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:00.280388 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6j8" event={"ID":"07d5b085-594c-4352-b03c-a8a558dd2904","Type":"ContainerStarted","Data":"98269e0d507d1cd260d044080d05ce93d49c1bcc494d8df2dce50576d3bb3f64"} May 31 17:26:01.284856 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:01.284818 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6j8" event={"ID":"07d5b085-594c-4352-b03c-a8a558dd2904","Type":"ContainerStarted","Data":"b0cc526c991981b15d6ebed609d3002407aed094db648f9c9ac67ef2fcf7b8c0"} May 31 17:26:01.307109 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:01.307059 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qb6j8" podStartSLOduration=9.41398654 podStartE2EDuration="11.30704174s" podCreationTimestamp="2026-05-31 17:25:50 +0000 UTC" firstStartedPulling="2026-05-31 17:25:58.84156522 +0000 UTC m=+167.686192213" lastFinishedPulling="2026-05-31 17:26:00.734620415 +0000 UTC m=+169.579247413" observedRunningTime="2026-05-31 17:26:01.305203724 +0000 UTC m=+170.149830741" watchObservedRunningTime="2026-05-31 17:26:01.30704174 +0000 UTC m=+170.151668756" May 31 17:26:01.753926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:01.753898 2569 scope.go:117] "RemoveContainer" containerID="c1ba5577163aa57f7731ee4b87db1e0b8cb3280debe298e18bb5e41a1288d295" May 31 17:26:02.288790 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:02.288760 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:26:02.289221 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:02.289198 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/1.log" May 31 17:26:02.289265 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:02.289226 2569 generic.go:358] "Generic (PLEG): container finished" podID="995ded47-c9c0-4571-9f75-9879ed966dc0" containerID="03cf62b87ce79f3a89827b48c7585b967036b5b21d12a1294eda81926947e9d1" exitCode=255 May 31 17:26:02.289329 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:02.289307 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" event={"ID":"995ded47-c9c0-4571-9f75-9879ed966dc0","Type":"ContainerDied","Data":"03cf62b87ce79f3a89827b48c7585b967036b5b21d12a1294eda81926947e9d1"} May 31 17:26:02.289367 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:02.289355 2569 scope.go:117] "RemoveContainer" containerID="c1ba5577163aa57f7731ee4b87db1e0b8cb3280debe298e18bb5e41a1288d295" May 31 17:26:02.289825 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:02.289803 2569 scope.go:117] "RemoveContainer" containerID="03cf62b87ce79f3a89827b48c7585b967036b5b21d12a1294eda81926947e9d1" May 31 17:26:02.289989 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:26:02.289973 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-qkn6w_openshift-console-operator(995ded47-c9c0-4571-9f75-9879ed966dc0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" podUID="995ded47-c9c0-4571-9f75-9879ed966dc0" May 31 17:26:02.753047 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:02.753014 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:26:03.292763 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:03.292737 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:26:07.838355 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:07.838303 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:26:07.838355 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:07.838358 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:26:07.838823 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:07.838691 2569 scope.go:117] "RemoveContainer" containerID="03cf62b87ce79f3a89827b48c7585b967036b5b21d12a1294eda81926947e9d1" May 31 17:26:07.838862 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:26:07.838847 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-qkn6w_openshift-console-operator(995ded47-c9c0-4571-9f75-9879ed966dc0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" podUID="995ded47-c9c0-4571-9f75-9879ed966dc0" May 31 17:26:10.871405 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.871370 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz"] May 31 17:26:10.904665 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.904629 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz"] May 31 17:26:10.904831 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.904753 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" May 31 17:26:10.908475 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.908450 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z7qdx\"" May 31 17:26:10.908640 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.908516 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 31 17:26:10.909695 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.909677 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cf6765bfc-fkwxz"] May 31 17:26:10.931824 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.931795 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf6765bfc-fkwxz"] May 31 17:26:10.931997 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.931910 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:10.934714 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.934690 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 31 17:26:10.934953 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.934937 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 31 17:26:10.935048 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.934986 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 31 17:26:10.935256 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.935237 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s9j7s\"" May 31 17:26:10.941235 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.941216 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 31 17:26:10.959959 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.959915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-bound-sa-token\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:10.959959 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.959963 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95b7d8da-839a-4553-beac-e80198e2eb17-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jfclz\" (UID: \"95b7d8da-839a-4553-beac-e80198e2eb17\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" May 31 17:26:10.960131 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.960013 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f31f2e11-eade-4751-8f02-720253feed81-image-registry-private-configuration\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:10.960131 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.960087 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f31f2e11-eade-4751-8f02-720253feed81-registry-certificates\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:10.960131 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.960104 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f31f2e11-eade-4751-8f02-720253feed81-installation-pull-secrets\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:10.960226 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.960145 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f31f2e11-eade-4751-8f02-720253feed81-trusted-ca\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:10.960226 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.960167 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f31f2e11-eade-4751-8f02-720253feed81-ca-trust-extracted\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:10.960226 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.960183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sj9f\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-kube-api-access-6sj9f\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:10.960226 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:10.960211 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-registry-tls\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.061468 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061432 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-bound-sa-token\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.061468 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061472 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95b7d8da-839a-4553-beac-e80198e2eb17-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jfclz\" (UID: \"95b7d8da-839a-4553-beac-e80198e2eb17\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" May 31 17:26:11.061739 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061513 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f31f2e11-eade-4751-8f02-720253feed81-image-registry-private-configuration\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.061739 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061540 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f31f2e11-eade-4751-8f02-720253feed81-registry-certificates\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.061739 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061557 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f31f2e11-eade-4751-8f02-720253feed81-installation-pull-secrets\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.061739 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061577 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f31f2e11-eade-4751-8f02-720253feed81-trusted-ca\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.061739 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061594 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f31f2e11-eade-4751-8f02-720253feed81-ca-trust-extracted\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.061739 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061611 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sj9f\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-kube-api-access-6sj9f\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.061739 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.061641 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-registry-tls\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.062123 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.062049 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f31f2e11-eade-4751-8f02-720253feed81-ca-trust-extracted\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.062515 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.062471 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f31f2e11-eade-4751-8f02-720253feed81-registry-certificates\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.062603 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.062571 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f31f2e11-eade-4751-8f02-720253feed81-trusted-ca\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.064385 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.064359 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f31f2e11-eade-4751-8f02-720253feed81-image-registry-private-configuration\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.064479 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.064366 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95b7d8da-839a-4553-beac-e80198e2eb17-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jfclz\" (UID: \"95b7d8da-839a-4553-beac-e80198e2eb17\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" May 31 17:26:11.064775 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.064751 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f31f2e11-eade-4751-8f02-720253feed81-installation-pull-secrets\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.064834 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.064820 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-registry-tls\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.079301 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.079271 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-bound-sa-token\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.079531 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.079513 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sj9f\" (UniqueName: \"kubernetes.io/projected/f31f2e11-eade-4751-8f02-720253feed81-kube-api-access-6sj9f\") pod \"image-registry-6cf6765bfc-fkwxz\" (UID: \"f31f2e11-eade-4751-8f02-720253feed81\") " pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.216835 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.216734 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" May 31 17:26:11.241969 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.241938 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:11.356546 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.356483 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz"] May 31 17:26:11.359746 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:26:11.359701 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b7d8da_839a_4553_beac_e80198e2eb17.slice/crio-e49dcddaefc0e32174b0b4b48102ece7bd1fa07ef9d69ed37aff51eb8c380e8d WatchSource:0}: Error finding container e49dcddaefc0e32174b0b4b48102ece7bd1fa07ef9d69ed37aff51eb8c380e8d: Status 404 returned error can't find the container with id e49dcddaefc0e32174b0b4b48102ece7bd1fa07ef9d69ed37aff51eb8c380e8d May 31 17:26:11.380928 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:11.380879 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf6765bfc-fkwxz"] May 31 17:26:11.384819 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:26:11.384791 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31f2e11_eade_4751_8f02_720253feed81.slice/crio-5e6ea14a8338cce17bf72e59c84bc8a3a21acd32e66f4a8a15502b95f7c4363a WatchSource:0}: Error finding container 5e6ea14a8338cce17bf72e59c84bc8a3a21acd32e66f4a8a15502b95f7c4363a: Status 404 returned error can't find the container with id 5e6ea14a8338cce17bf72e59c84bc8a3a21acd32e66f4a8a15502b95f7c4363a May 31 17:26:12.318943 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:12.318892 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" event={"ID":"95b7d8da-839a-4553-beac-e80198e2eb17","Type":"ContainerStarted","Data":"e49dcddaefc0e32174b0b4b48102ece7bd1fa07ef9d69ed37aff51eb8c380e8d"} May 31 17:26:12.320314 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:12.320286 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" event={"ID":"f31f2e11-eade-4751-8f02-720253feed81","Type":"ContainerStarted","Data":"21ea8be405747ca50e09bf7b37f48b608014a612599b7edb59e76512d7224286"} May 31 17:26:12.320456 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:12.320317 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" event={"ID":"f31f2e11-eade-4751-8f02-720253feed81","Type":"ContainerStarted","Data":"5e6ea14a8338cce17bf72e59c84bc8a3a21acd32e66f4a8a15502b95f7c4363a"} May 31 17:26:12.320537 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:12.320475 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:12.344865 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:12.344805 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podStartSLOduration=2.344791445 podStartE2EDuration="2.344791445s" podCreationTimestamp="2026-05-31 17:26:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:26:12.343230754 +0000 UTC m=+181.187857768" watchObservedRunningTime="2026-05-31 17:26:12.344791445 +0000 UTC m=+181.189418461" May 31 17:26:13.324699 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:13.324645 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" event={"ID":"95b7d8da-839a-4553-beac-e80198e2eb17","Type":"ContainerStarted","Data":"b655eed15ca7d9486868cbfc142be9477ad5b9e1ab4b19c050153d792b97a6dd"} May 31 17:26:13.342303 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:13.342249 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" podStartSLOduration=2.155485425 podStartE2EDuration="3.342235906s" podCreationTimestamp="2026-05-31 17:26:10 +0000 UTC" firstStartedPulling="2026-05-31 17:26:11.36164352 +0000 UTC m=+180.206270513" lastFinishedPulling="2026-05-31 17:26:12.548394001 +0000 UTC m=+181.393020994" observedRunningTime="2026-05-31 17:26:13.341373864 +0000 UTC m=+182.186000878" watchObservedRunningTime="2026-05-31 17:26:13.342235906 +0000 UTC m=+182.186862921" May 31 17:26:14.327373 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:14.327346 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" May 31 17:26:14.332921 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:14.332896 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jfclz" May 31 17:26:15.213268 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.213231 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p"] May 31 17:26:15.215248 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.215233 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.218000 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.217976 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 31 17:26:15.218143 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.218000 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 31 17:26:15.218143 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.218028 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ns8bl\"" May 31 17:26:15.218143 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.218077 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 31 17:26:15.218446 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.218431 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 31 17:26:15.218696 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.218676 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 31 17:26:15.231271 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.231250 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p"] May 31 17:26:15.293137 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.293090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57g4\" (UniqueName: \"kubernetes.io/projected/e316220d-b9a0-413a-87a5-436a55445313-kube-api-access-z57g4\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.293333 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.293204 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e316220d-b9a0-413a-87a5-436a55445313-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.293333 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.293238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e316220d-b9a0-413a-87a5-436a55445313-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.293333 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.293265 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e316220d-b9a0-413a-87a5-436a55445313-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.394165 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.394122 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e316220d-b9a0-413a-87a5-436a55445313-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.394165 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.394171 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e316220d-b9a0-413a-87a5-436a55445313-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.394717 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.394227 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z57g4\" (UniqueName: \"kubernetes.io/projected/e316220d-b9a0-413a-87a5-436a55445313-kube-api-access-z57g4\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.394717 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.394462 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e316220d-b9a0-413a-87a5-436a55445313-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.395070 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.395052 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e316220d-b9a0-413a-87a5-436a55445313-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.396782 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.396753 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e316220d-b9a0-413a-87a5-436a55445313-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.396946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.396923 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e316220d-b9a0-413a-87a5-436a55445313-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.402335 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.402313 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57g4\" (UniqueName: \"kubernetes.io/projected/e316220d-b9a0-413a-87a5-436a55445313-kube-api-access-z57g4\") pod \"prometheus-operator-658bcd8bdf-nxz9p\" (UID: \"e316220d-b9a0-413a-87a5-436a55445313\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.524798 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.524718 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" May 31 17:26:15.651919 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:15.651888 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p"] May 31 17:26:15.655026 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:26:15.654998 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode316220d_b9a0_413a_87a5_436a55445313.slice/crio-3368c0f195c8fb40ed0cd1585131db81ff7e548ccb449bd654a0ad1cd96489f7 WatchSource:0}: Error finding container 3368c0f195c8fb40ed0cd1585131db81ff7e548ccb449bd654a0ad1cd96489f7: Status 404 returned error can't find the container with id 3368c0f195c8fb40ed0cd1585131db81ff7e548ccb449bd654a0ad1cd96489f7 May 31 17:26:16.337870 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:16.337811 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" event={"ID":"e316220d-b9a0-413a-87a5-436a55445313","Type":"ContainerStarted","Data":"3368c0f195c8fb40ed0cd1585131db81ff7e548ccb449bd654a0ad1cd96489f7"} May 31 17:26:17.342379 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:17.342342 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" event={"ID":"e316220d-b9a0-413a-87a5-436a55445313","Type":"ContainerStarted","Data":"24efbefc366ed1b68cf2717050bb1bd154165bed93ddc432ac00df4dd143d3ff"} May 31 17:26:18.346224 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:18.346185 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" event={"ID":"e316220d-b9a0-413a-87a5-436a55445313","Type":"ContainerStarted","Data":"619e35efc41ef38b3a8c2160bdf62b00e797703925e98d2388d1feb7130ab9ea"} May 31 17:26:18.365041 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:18.364989 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nxz9p" podStartSLOduration=1.800964221 podStartE2EDuration="3.364973425s" podCreationTimestamp="2026-05-31 17:26:15 +0000 UTC" firstStartedPulling="2026-05-31 17:26:15.65690086 +0000 UTC m=+184.501527854" lastFinishedPulling="2026-05-31 17:26:17.220910065 +0000 UTC m=+186.065537058" observedRunningTime="2026-05-31 17:26:18.364304111 +0000 UTC m=+187.208931125" watchObservedRunningTime="2026-05-31 17:26:18.364973425 +0000 UTC m=+187.209600441" May 31 17:26:20.570010 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.569978 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k"] May 31 17:26:20.580550 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.580515 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8bcrc"] May 31 17:26:20.580722 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.580670 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.583532 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.583507 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k"] May 31 17:26:20.583819 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.583802 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.584609 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.584586 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 31 17:26:20.584726 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.584597 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 31 17:26:20.584874 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.584857 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mcsnh\"" May 31 17:26:20.585291 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.585271 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 31 17:26:20.586800 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.586776 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 31 17:26:20.586913 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.586894 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 31 17:26:20.587013 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.586995 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 31 17:26:20.587246 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.587226 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9m29w\"" May 31 17:26:20.638404 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638362 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.638620 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638437 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-textfile\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.638620 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638470 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9da71949-3517-4d8b-be96-9b0f0432b2c2-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.638620 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.638620 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638569 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-745r4\" (UniqueName: \"kubernetes.io/projected/ba157311-a142-46e2-aae3-a2b5b85262fd-kube-api-access-745r4\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.638620 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638608 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9da71949-3517-4d8b-be96-9b0f0432b2c2-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.638867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.638867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638705 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szjmd\" (UniqueName: \"kubernetes.io/projected/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-api-access-szjmd\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.638867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638734 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-root\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.638867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638767 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.638867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638823 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-sys\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.638867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638848 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba157311-a142-46e2-aae3-a2b5b85262fd-metrics-client-ca\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.639157 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638880 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-tls\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.639157 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638907 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-wtmp\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.639157 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.638928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.740054 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740009 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740054 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740064 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-textfile\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740304 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740198 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9da71949-3517-4d8b-be96-9b0f0432b2c2-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.740304 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740248 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740304 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740276 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-745r4\" (UniqueName: \"kubernetes.io/projected/ba157311-a142-46e2-aae3-a2b5b85262fd-kube-api-access-745r4\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740304 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740303 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9da71949-3517-4d8b-be96-9b0f0432b2c2-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.740532 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740339 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.740532 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740377 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-textfile\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740532 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740387 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szjmd\" (UniqueName: \"kubernetes.io/projected/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-api-access-szjmd\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.740532 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740432 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-root\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740532 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740470 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.740783 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740534 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-sys\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740783 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740558 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba157311-a142-46e2-aae3-a2b5b85262fd-metrics-client-ca\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740783 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740587 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-tls\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740783 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740627 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-wtmp\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740783 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740744 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.740783 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740756 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-wtmp\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.741063 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740803 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-sys\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.741063 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740818 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba157311-a142-46e2-aae3-a2b5b85262fd-root\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.741063 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.740991 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9da71949-3517-4d8b-be96-9b0f0432b2c2-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.741219 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.741088 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9da71949-3517-4d8b-be96-9b0f0432b2c2-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.741219 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.741105 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.741322 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.741240 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba157311-a142-46e2-aae3-a2b5b85262fd-metrics-client-ca\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.742019 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.741993 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.743251 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.743227 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.743363 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.743327 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.743436 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.743390 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba157311-a142-46e2-aae3-a2b5b85262fd-node-exporter-tls\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.743574 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.743554 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.751420 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.751385 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-745r4\" (UniqueName: \"kubernetes.io/projected/ba157311-a142-46e2-aae3-a2b5b85262fd-kube-api-access-745r4\") pod \"node-exporter-8bcrc\" (UID: \"ba157311-a142-46e2-aae3-a2b5b85262fd\") " pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.751526 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.751396 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szjmd\" (UniqueName: \"kubernetes.io/projected/9da71949-3517-4d8b-be96-9b0f0432b2c2-kube-api-access-szjmd\") pod \"kube-state-metrics-8469c486bb-lvp7k\" (UID: \"9da71949-3517-4d8b-be96-9b0f0432b2c2\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.896908 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.896871 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" May 31 17:26:20.906716 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:20.906684 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8bcrc" May 31 17:26:20.917758 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:26:20.917712 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba157311_a142_46e2_aae3_a2b5b85262fd.slice/crio-430458398fd3f0672765352e52f11b2438dec2eb5b4957acff47488932d13464 WatchSource:0}: Error finding container 430458398fd3f0672765352e52f11b2438dec2eb5b4957acff47488932d13464: Status 404 returned error can't find the container with id 430458398fd3f0672765352e52f11b2438dec2eb5b4957acff47488932d13464 May 31 17:26:21.033104 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.032987 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k"] May 31 17:26:21.035660 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:26:21.035636 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da71949_3517_4d8b_be96_9b0f0432b2c2.slice/crio-44161bcc79ddab5469d15e75ff12e5a8530aec61eb890c1a69e68dd18791c2f5 WatchSource:0}: Error finding container 44161bcc79ddab5469d15e75ff12e5a8530aec61eb890c1a69e68dd18791c2f5: Status 404 returned error can't find the container with id 44161bcc79ddab5469d15e75ff12e5a8530aec61eb890c1a69e68dd18791c2f5 May 31 17:26:21.354943 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.354898 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" event={"ID":"9da71949-3517-4d8b-be96-9b0f0432b2c2","Type":"ContainerStarted","Data":"44161bcc79ddab5469d15e75ff12e5a8530aec61eb890c1a69e68dd18791c2f5"} May 31 17:26:21.355963 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.355934 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bcrc" event={"ID":"ba157311-a142-46e2-aae3-a2b5b85262fd","Type":"ContainerStarted","Data":"430458398fd3f0672765352e52f11b2438dec2eb5b4957acff47488932d13464"} May 31 17:26:21.643077 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.642880 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:26:21.647151 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.647130 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.649546 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.649782 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.650117 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.650317 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.650540 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.650717 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.650909 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.651116 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ktpv2\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.651210 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 31 17:26:21.651346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.651238 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 31 17:26:21.658166 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.658127 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:26:21.748876 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.748839 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749038 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.748888 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-web-config\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749038 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.748919 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749038 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.748957 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749038 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.748986 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749246 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.749047 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kgg6\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-kube-api-access-9kgg6\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749246 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.749084 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-out\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749246 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.749133 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749246 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.749168 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749451 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.749276 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749451 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.749305 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749451 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.749349 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.749451 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.749387 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.849988 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.849943 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850172 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850001 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850172 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850045 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850172 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850085 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850172 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850126 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850418 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850190 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-web-config\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850418 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850223 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850418 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:26:21.850295 2569 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 31 17:26:21.850418 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:26:21.850374 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls podName:1f709ab2-c675-466e-9c1b-c8f09bf91a1f nodeName:}" failed. No retries permitted until 2026-05-31 17:26:22.35035249 +0000 UTC m=+191.194979488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f") : secret "alertmanager-main-tls" not found May 31 17:26:21.850650 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850296 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850650 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850591 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850757 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850661 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kgg6\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-kube-api-access-9kgg6\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.850757 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.850705 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-out\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.851038 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.851011 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.851627 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.851603 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.852736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.852679 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.852736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.852715 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.853105 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.853084 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.853833 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.853808 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.853925 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.853906 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.854115 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.854066 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.854256 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.854190 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.854700 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.854676 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-web-config\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.856151 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.856104 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.856644 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.856613 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.856798 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.856777 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-out\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:21.866008 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:21.865967 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kgg6\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-kube-api-access-9kgg6\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:22.356764 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:22.356731 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:22.359880 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:22.359850 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:22.360512 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:22.360458 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bcrc" event={"ID":"ba157311-a142-46e2-aae3-a2b5b85262fd","Type":"ContainerStarted","Data":"ca66a2fae41b1e32b8a69dbc7319f4f27f854d80e34f825ece44e15d1fc12dfd"} May 31 17:26:22.560528 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:22.560480 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 31 17:26:22.733758 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:22.733725 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:26:22.735220 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:26:22.735196 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f709ab2_c675_466e_9c1b_c8f09bf91a1f.slice/crio-613a325144aa3a610b2ed1954415a60be80cbf5a16b5e276a3ab59f0d4cee241 WatchSource:0}: Error finding container 613a325144aa3a610b2ed1954415a60be80cbf5a16b5e276a3ab59f0d4cee241: Status 404 returned error can't find the container with id 613a325144aa3a610b2ed1954415a60be80cbf5a16b5e276a3ab59f0d4cee241 May 31 17:26:22.752717 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:22.752658 2569 scope.go:117] "RemoveContainer" containerID="03cf62b87ce79f3a89827b48c7585b967036b5b21d12a1294eda81926947e9d1" May 31 17:26:23.369455 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.369414 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" event={"ID":"9da71949-3517-4d8b-be96-9b0f0432b2c2","Type":"ContainerStarted","Data":"53b29d94e3dd0981f531931e40dbcb3aed372c6fbe0ad02b7b2cf9a565fd84bf"} May 31 17:26:23.369455 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.369461 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" event={"ID":"9da71949-3517-4d8b-be96-9b0f0432b2c2","Type":"ContainerStarted","Data":"3268ed2930a4e0b8a50c696c97d424294b43f7093d6182779456d6c6e861778d"} May 31 17:26:23.369730 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.369475 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" event={"ID":"9da71949-3517-4d8b-be96-9b0f0432b2c2","Type":"ContainerStarted","Data":"256d4e8ccd4858d259d98f2aaace4744f6c38d4c3c29d0d1f4cebf56a4f76dc1"} May 31 17:26:23.371226 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.371089 2569 generic.go:358] "Generic (PLEG): container finished" podID="ba157311-a142-46e2-aae3-a2b5b85262fd" containerID="ca66a2fae41b1e32b8a69dbc7319f4f27f854d80e34f825ece44e15d1fc12dfd" exitCode=0 May 31 17:26:23.371226 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.371159 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bcrc" event={"ID":"ba157311-a142-46e2-aae3-a2b5b85262fd","Type":"ContainerDied","Data":"ca66a2fae41b1e32b8a69dbc7319f4f27f854d80e34f825ece44e15d1fc12dfd"} May 31 17:26:23.372560 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.372531 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerStarted","Data":"613a325144aa3a610b2ed1954415a60be80cbf5a16b5e276a3ab59f0d4cee241"} May 31 17:26:23.374461 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.374442 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:26:23.374596 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.374516 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" event={"ID":"995ded47-c9c0-4571-9f75-9879ed966dc0","Type":"ContainerStarted","Data":"be981b08ea832df395311e0b8758c776007450f03385085c4aca999f7481c9d8"} May 31 17:26:23.374963 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.374945 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:26:23.387479 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.387424 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-lvp7k" podStartSLOduration=1.9578080519999999 podStartE2EDuration="3.387405489s" podCreationTimestamp="2026-05-31 17:26:20 +0000 UTC" firstStartedPulling="2026-05-31 17:26:21.037941908 +0000 UTC m=+189.882568901" lastFinishedPulling="2026-05-31 17:26:22.467539345 +0000 UTC m=+191.312166338" observedRunningTime="2026-05-31 17:26:23.385786756 +0000 UTC m=+192.230413772" watchObservedRunningTime="2026-05-31 17:26:23.387405489 +0000 UTC m=+192.232032507" May 31 17:26:23.404729 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:23.404672 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" podStartSLOduration=44.441977698 podStartE2EDuration="46.404652518s" podCreationTimestamp="2026-05-31 17:25:37 +0000 UTC" firstStartedPulling="2026-05-31 17:25:37.97736269 +0000 UTC m=+146.821989683" lastFinishedPulling="2026-05-31 17:25:39.94003751 +0000 UTC m=+148.784664503" observedRunningTime="2026-05-31 17:26:23.403138771 +0000 UTC m=+192.247765788" watchObservedRunningTime="2026-05-31 17:26:23.404652518 +0000 UTC m=+192.249279534" May 31 17:26:24.374965 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:24.374913 2569 patch_prober.go:28] interesting pod/console-operator-86d7c6cc77-qkn6w container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.9:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= May 31 17:26:24.375409 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:24.375014 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" podUID="995ded47-c9c0-4571-9f75-9879ed966dc0" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.9:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" May 31 17:26:24.379157 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:24.379127 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bcrc" event={"ID":"ba157311-a142-46e2-aae3-a2b5b85262fd","Type":"ContainerStarted","Data":"e0c86acafecb678b903023606939d24d529f5669ee315c06d49f9fba09f538d2"} May 31 17:26:24.379293 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:24.379161 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bcrc" event={"ID":"ba157311-a142-46e2-aae3-a2b5b85262fd","Type":"ContainerStarted","Data":"3af919ba687da932679a3ca231c976d068e3ce4a2a2b130dc8d7bfa4a62fd557"} May 31 17:26:24.380605 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:24.380580 2569 generic.go:358] "Generic (PLEG): container finished" podID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerID="6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b" exitCode=0 May 31 17:26:24.380722 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:24.380660 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerDied","Data":"6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b"} May 31 17:26:24.399108 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:24.399060 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8bcrc" podStartSLOduration=3.307567713 podStartE2EDuration="4.399046659s" podCreationTimestamp="2026-05-31 17:26:20 +0000 UTC" firstStartedPulling="2026-05-31 17:26:20.920137357 +0000 UTC m=+189.764764353" lastFinishedPulling="2026-05-31 17:26:22.011616305 +0000 UTC m=+190.856243299" observedRunningTime="2026-05-31 17:26:24.397259463 +0000 UTC m=+193.241886473" watchObservedRunningTime="2026-05-31 17:26:24.399046659 +0000 UTC m=+193.243673674" May 31 17:26:24.614271 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:24.614239 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-qkn6w" May 31 17:26:26.388840 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.388805 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerStarted","Data":"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d"} May 31 17:26:26.388840 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.388842 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerStarted","Data":"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874"} May 31 17:26:26.389245 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.388855 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerStarted","Data":"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c"} May 31 17:26:26.389245 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.388863 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerStarted","Data":"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a"} May 31 17:26:26.389245 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.388873 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerStarted","Data":"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4"} May 31 17:26:26.815919 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.815873 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:26:26.820664 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.820636 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.824262 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.824087 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 31 17:26:26.824418 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.824394 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 31 17:26:26.824693 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.824667 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 31 17:26:26.824693 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.824691 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 31 17:26:26.825710 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.825683 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 31 17:26:26.826356 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.826338 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 31 17:26:26.827019 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.826844 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 31 17:26:26.827019 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.826858 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fdwrh\"" May 31 17:26:26.827242 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.827175 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-60pdo6j198o6k\"" May 31 17:26:26.827405 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.827354 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 31 17:26:26.827681 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.827593 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 31 17:26:26.827681 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.827655 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 31 17:26:26.827852 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.827704 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 31 17:26:26.828740 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.828721 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 31 17:26:26.829660 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.829640 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 31 17:26:26.842977 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.842940 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:26:26.902459 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902421 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.902660 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902477 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.902660 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902554 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-config\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.902660 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902614 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.902808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.902808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902698 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-config-out\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.902808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902753 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.902808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902802 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903020 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902875 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903020 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902911 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-web-config\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903020 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjsb2\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-kube-api-access-mjsb2\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903020 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.902998 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903213 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.903027 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903213 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.903071 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903213 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.903091 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903213 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.903149 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903213 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.903169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:26.903213 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:26.903213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.004511 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.004453 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.004695 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.004528 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.004695 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.004583 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.004695 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.004607 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.004695 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.004667 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.004695 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.004691 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.004991 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.004976 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005050 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005022 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005099 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005061 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005150 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005095 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-config\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005150 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005124 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005248 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005154 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005248 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005180 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-config-out\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005248 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005213 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005386 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005250 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005386 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005305 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005386 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005333 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-web-config\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005386 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005376 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjsb2\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-kube-api-access-mjsb2\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005596 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005437 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005596 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005556 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.005826 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.005798 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.010443 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.009899 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.010443 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.010157 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.010794 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.010770 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.011625 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.011599 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.012241 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.012007 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.012961 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.012936 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-web-config\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.013429 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.013406 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.013770 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.013733 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.014736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.014692 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjsb2\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-kube-api-access-mjsb2\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.015248 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.015209 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-config\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.015572 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.015457 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.015572 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.015535 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-config-out\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.015709 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.015612 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.015940 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.015920 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.016265 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.016249 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.135822 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.135781 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:27.317876 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.317847 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:26:27.320009 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:26:27.319979 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57688b42_168b_4c20_9785_325d9893d45d.slice/crio-d176e2ae0503cd3b06956f66778ec3474cf7b8ddf334a851b0dd682fa93fe75e WatchSource:0}: Error finding container d176e2ae0503cd3b06956f66778ec3474cf7b8ddf334a851b0dd682fa93fe75e: Status 404 returned error can't find the container with id d176e2ae0503cd3b06956f66778ec3474cf7b8ddf334a851b0dd682fa93fe75e May 31 17:26:27.395529 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.395472 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerStarted","Data":"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8"} May 31 17:26:27.396569 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.396546 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerStarted","Data":"d176e2ae0503cd3b06956f66778ec3474cf7b8ddf334a851b0dd682fa93fe75e"} May 31 17:26:27.423202 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:27.422957 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.9960173399999999 podStartE2EDuration="6.422936892s" podCreationTimestamp="2026-05-31 17:26:21 +0000 UTC" firstStartedPulling="2026-05-31 17:26:22.73761168 +0000 UTC m=+191.582238672" lastFinishedPulling="2026-05-31 17:26:27.164531209 +0000 UTC m=+196.009158224" observedRunningTime="2026-05-31 17:26:27.421635627 +0000 UTC m=+196.266262645" watchObservedRunningTime="2026-05-31 17:26:27.422936892 +0000 UTC m=+196.267563909" May 31 17:26:28.400798 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:28.400756 2569 generic.go:358] "Generic (PLEG): container finished" podID="57688b42-168b-4c20-9785-325d9893d45d" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" exitCode=0 May 31 17:26:28.401165 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:28.400845 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerDied","Data":"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a"} May 31 17:26:31.246644 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:31.246607 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:26:31.246995 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:31.246674 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:26:31.414117 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:31.414068 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerStarted","Data":"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035"} May 31 17:26:31.414117 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:31.414120 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerStarted","Data":"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152"} May 31 17:26:33.329453 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:33.329411 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:26:33.329879 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:33.329466 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:26:33.422349 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:33.422313 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerStarted","Data":"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae"} May 31 17:26:33.422349 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:33.422351 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerStarted","Data":"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6"} May 31 17:26:33.422598 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:33.422363 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerStarted","Data":"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2"} May 31 17:26:33.422598 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:33.422371 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerStarted","Data":"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e"} May 31 17:26:33.450850 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:33.450801 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8748616289999998 podStartE2EDuration="7.450761708s" podCreationTimestamp="2026-05-31 17:26:26 +0000 UTC" firstStartedPulling="2026-05-31 17:26:28.402029345 +0000 UTC m=+197.246656338" lastFinishedPulling="2026-05-31 17:26:32.977929424 +0000 UTC m=+201.822556417" observedRunningTime="2026-05-31 17:26:33.448432394 +0000 UTC m=+202.293059420" watchObservedRunningTime="2026-05-31 17:26:33.450761708 +0000 UTC m=+202.295388723" May 31 17:26:37.136652 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:37.136596 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:26:41.246364 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:41.246323 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:26:41.246784 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:41.246392 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:26:43.329166 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:43.329127 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:26:43.329594 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:43.329181 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:26:50.475190 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:50.475155 2569 generic.go:358] "Generic (PLEG): container finished" podID="f35ff586-dd68-442e-96d8-fefaae59c84b" containerID="93b7c10e3c5c7777ace9257c9c6c4271b948e91a55655fc65f19961ed3c4e4bf" exitCode=0 May 31 17:26:50.475626 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:50.475229 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" event={"ID":"f35ff586-dd68-442e-96d8-fefaae59c84b","Type":"ContainerDied","Data":"93b7c10e3c5c7777ace9257c9c6c4271b948e91a55655fc65f19961ed3c4e4bf"} May 31 17:26:50.475626 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:50.475608 2569 scope.go:117] "RemoveContainer" containerID="93b7c10e3c5c7777ace9257c9c6c4271b948e91a55655fc65f19961ed3c4e4bf" May 31 17:26:51.246609 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:51.246576 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:26:51.246805 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:51.246625 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:26:51.246805 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:51.246667 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:26:51.247137 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:51.247107 2569 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"21ea8be405747ca50e09bf7b37f48b608014a612599b7edb59e76512d7224286"} pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" containerMessage="Container registry failed liveness probe, will be restarted" May 31 17:26:51.251848 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:51.251810 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:26:51.251977 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:51.251867 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:26:51.479377 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:51.479340 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-rfrpn" event={"ID":"f35ff586-dd68-442e-96d8-fefaae59c84b","Type":"ContainerStarted","Data":"99d3c3388329db03c3e0972fdae217007cfe78449fc20b5770e8a5d6fc1a562e"} May 31 17:26:52.483752 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:52.483712 2569 generic.go:358] "Generic (PLEG): container finished" podID="20c8f248-6378-4f89-b3a6-d4a34b6a9b47" containerID="aa0c766c7159cb76479a06ebe0c75851fd5d41977ba38091e4ff59ce613fd32a" exitCode=0 May 31 17:26:52.484225 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:52.483788 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-cnzn9" event={"ID":"20c8f248-6378-4f89-b3a6-d4a34b6a9b47","Type":"ContainerDied","Data":"aa0c766c7159cb76479a06ebe0c75851fd5d41977ba38091e4ff59ce613fd32a"} May 31 17:26:52.484287 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:52.484257 2569 scope.go:117] "RemoveContainer" containerID="aa0c766c7159cb76479a06ebe0c75851fd5d41977ba38091e4ff59ce613fd32a" May 31 17:26:53.488202 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:53.488164 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-cnzn9" event={"ID":"20c8f248-6378-4f89-b3a6-d4a34b6a9b47","Type":"ContainerStarted","Data":"fcf654e0e6cf400200f846f8fe912d737793470c10218a8eb7450ddc04a07ab1"} May 31 17:26:55.170944 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:55.170911 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f709ab2-c675-466e-9c1b-c8f09bf91a1f/init-config-reloader/0.log" May 31 17:26:55.370651 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:55.370621 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f709ab2-c675-466e-9c1b-c8f09bf91a1f/alertmanager/0.log" May 31 17:26:55.569917 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:55.569844 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f709ab2-c675-466e-9c1b-c8f09bf91a1f/config-reloader/0.log" May 31 17:26:55.769532 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:55.769503 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f709ab2-c675-466e-9c1b-c8f09bf91a1f/kube-rbac-proxy-web/0.log" May 31 17:26:55.969003 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:55.968977 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f709ab2-c675-466e-9c1b-c8f09bf91a1f/kube-rbac-proxy/0.log" May 31 17:26:56.169052 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:56.169024 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f709ab2-c675-466e-9c1b-c8f09bf91a1f/kube-rbac-proxy-metric/0.log" May 31 17:26:56.370017 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:56.369990 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f709ab2-c675-466e-9c1b-c8f09bf91a1f/prom-label-proxy/0.log" May 31 17:26:56.769378 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:56.769304 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-lvp7k_9da71949-3517-4d8b-be96-9b0f0432b2c2/kube-state-metrics/0.log" May 31 17:26:56.969591 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:56.969562 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-lvp7k_9da71949-3517-4d8b-be96-9b0f0432b2c2/kube-rbac-proxy-main/0.log" May 31 17:26:57.169964 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:57.169942 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-lvp7k_9da71949-3517-4d8b-be96-9b0f0432b2c2/kube-rbac-proxy-self/0.log" May 31 17:26:58.369535 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:58.369480 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bcrc_ba157311-a142-46e2-aae3-a2b5b85262fd/init-textfile/0.log" May 31 17:26:58.569872 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:58.569839 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bcrc_ba157311-a142-46e2-aae3-a2b5b85262fd/node-exporter/0.log" May 31 17:26:58.770074 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:26:58.769997 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bcrc_ba157311-a142-46e2-aae3-a2b5b85262fd/kube-rbac-proxy/0.log" May 31 17:27:00.169189 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:00.169160 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57688b42-168b-4c20-9785-325d9893d45d/init-config-reloader/0.log" May 31 17:27:00.370996 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:00.370968 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57688b42-168b-4c20-9785-325d9893d45d/prometheus/0.log" May 31 17:27:00.569481 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:00.569403 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57688b42-168b-4c20-9785-325d9893d45d/config-reloader/0.log" May 31 17:27:00.771015 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:00.770989 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57688b42-168b-4c20-9785-325d9893d45d/thanos-sidecar/0.log" May 31 17:27:00.968844 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:00.968814 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57688b42-168b-4c20-9785-325d9893d45d/kube-rbac-proxy-web/0.log" May 31 17:27:01.170166 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:01.170137 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57688b42-168b-4c20-9785-325d9893d45d/kube-rbac-proxy/0.log" May 31 17:27:01.251576 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:01.251477 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:27:01.251576 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:01.251560 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:27:01.368736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:01.368708 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57688b42-168b-4c20-9785-325d9893d45d/kube-rbac-proxy-thanos/0.log" May 31 17:27:01.570818 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:01.570746 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-nxz9p_e316220d-b9a0-413a-87a5-436a55445313/prometheus-operator/0.log" May 31 17:27:01.769186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:01.769158 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-nxz9p_e316220d-b9a0-413a-87a5-436a55445313/kube-rbac-proxy/0.log" May 31 17:27:01.969197 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:01.969160 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-jfclz_95b7d8da-839a-4553-beac-e80198e2eb17/prometheus-operator-admission-webhook/0.log" May 31 17:27:03.516725 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:03.516690 2569 generic.go:358] "Generic (PLEG): container finished" podID="1cbe028c-006e-4344-b8ef-6feb3cc6cb88" containerID="7a73705eb794a4846d8e6accdb93eae37419cfdf900f1fed4b9c9c15b2d7e54b" exitCode=0 May 31 17:27:03.517093 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:03.516762 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" event={"ID":"1cbe028c-006e-4344-b8ef-6feb3cc6cb88","Type":"ContainerDied","Data":"7a73705eb794a4846d8e6accdb93eae37419cfdf900f1fed4b9c9c15b2d7e54b"} May 31 17:27:03.517093 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:03.517061 2569 scope.go:117] "RemoveContainer" containerID="7a73705eb794a4846d8e6accdb93eae37419cfdf900f1fed4b9c9c15b2d7e54b" May 31 17:27:03.584933 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:03.584897 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:27:03.771251 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:03.771172 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/3.log" May 31 17:27:04.521786 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:04.521746 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-s8k66" event={"ID":"1cbe028c-006e-4344-b8ef-6feb3cc6cb88","Type":"ContainerStarted","Data":"cef79af97d13349f1c36216cff46be824d4ebb9e9bc8251827c673b85b78c587"} May 31 17:27:05.768979 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:05.768950 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-27xb9_3bc6e587-62f0-4943-ad56-66ac1707325e/dns-node-resolver/0.log" May 31 17:27:06.370131 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:06.370102 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cf6765bfc-fkwxz_f31f2e11-eade-4751-8f02-720253feed81/registry/0.log" May 31 17:27:06.769277 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:06.769203 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f5jtz_3076a993-9118-4289-8f14-a8e9349d37d0/node-ca/0.log" May 31 17:27:11.251798 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:11.251763 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:27:11.252314 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:11.251824 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:27:16.267309 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:16.267265 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" containerID="cri-o://21ea8be405747ca50e09bf7b37f48b608014a612599b7edb59e76512d7224286" gracePeriod=30 May 31 17:27:17.563808 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:17.563770 2569 generic.go:358] "Generic (PLEG): container finished" podID="f31f2e11-eade-4751-8f02-720253feed81" containerID="21ea8be405747ca50e09bf7b37f48b608014a612599b7edb59e76512d7224286" exitCode=0 May 31 17:27:17.564191 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:17.563852 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" event={"ID":"f31f2e11-eade-4751-8f02-720253feed81","Type":"ContainerDied","Data":"21ea8be405747ca50e09bf7b37f48b608014a612599b7edb59e76512d7224286"} May 31 17:27:17.564191 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:17.563910 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" event={"ID":"f31f2e11-eade-4751-8f02-720253feed81","Type":"ContainerStarted","Data":"baf69e6cbd70c067751fb2f4e62a4bf27978eb0a10ce9d2ffb869bb68b308a44"} May 31 17:27:17.564191 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:17.564151 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:27:22.537877 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:22.537841 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:27:22.540421 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:22.540385 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/829a36da-0012-4624-8443-6808a574c032-metrics-certs\") pod \"network-metrics-daemon-kfgfg\" (UID: \"829a36da-0012-4624-8443-6808a574c032\") " pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:27:22.556013 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:22.555989 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrg\"" May 31 17:27:22.564211 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:22.564190 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfgfg" May 31 17:27:22.699168 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:22.699020 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kfgfg"] May 31 17:27:22.701868 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:27:22.701844 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829a36da_0012_4624_8443_6808a574c032.slice/crio-a57e0ecd50928b45f1cf4c0b9852d902c078c9ec17b0ed85f0aaf2ecf9253caa WatchSource:0}: Error finding container a57e0ecd50928b45f1cf4c0b9852d902c078c9ec17b0ed85f0aaf2ecf9253caa: Status 404 returned error can't find the container with id a57e0ecd50928b45f1cf4c0b9852d902c078c9ec17b0ed85f0aaf2ecf9253caa May 31 17:27:23.583738 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:23.583699 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfgfg" event={"ID":"829a36da-0012-4624-8443-6808a574c032","Type":"ContainerStarted","Data":"a57e0ecd50928b45f1cf4c0b9852d902c078c9ec17b0ed85f0aaf2ecf9253caa"} May 31 17:27:24.588128 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:24.588094 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfgfg" event={"ID":"829a36da-0012-4624-8443-6808a574c032","Type":"ContainerStarted","Data":"7d015382e685d5d11880441ca1bf43e37532d1bbb12527296dc8140ea1069eb0"} May 31 17:27:24.588128 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:24.588131 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfgfg" event={"ID":"829a36da-0012-4624-8443-6808a574c032","Type":"ContainerStarted","Data":"1fbb232a36511c8932f3144a5e1a3faada33ac210be87123e5a80b0fd61468c3"} May 31 17:27:24.607015 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:24.606968 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kfgfg" podStartSLOduration=252.551992626 podStartE2EDuration="4m13.606952295s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:27:22.703843632 +0000 UTC m=+251.548470625" lastFinishedPulling="2026-05-31 17:27:23.7588033 +0000 UTC m=+252.603430294" observedRunningTime="2026-05-31 17:27:24.605602559 +0000 UTC m=+253.450229585" watchObservedRunningTime="2026-05-31 17:27:24.606952295 +0000 UTC m=+253.451579310" May 31 17:27:27.136797 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:27.136759 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:27.157879 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:27.157849 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:27.614528 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:27.614471 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:31.247969 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:31.247879 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:27:31.247969 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:31.247945 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:27:38.571096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:38.571058 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:27:38.571477 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:38.571124 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:27:40.861282 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:40.861250 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:27:40.861735 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:40.861709 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="alertmanager" containerID="cri-o://bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4" gracePeriod=120 May 31 17:27:40.861828 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:40.861792 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy-metric" containerID="cri-o://da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d" gracePeriod=120 May 31 17:27:40.861893 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:40.861807 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy-web" containerID="cri-o://9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c" gracePeriod=120 May 31 17:27:40.861893 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:40.861847 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy" containerID="cri-o://2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874" gracePeriod=120 May 31 17:27:40.861893 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:40.861878 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="prom-label-proxy" containerID="cri-o://c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8" gracePeriod=120 May 31 17:27:40.862346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:40.861831 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="config-reloader" containerID="cri-o://b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a" gracePeriod=120 May 31 17:27:41.246334 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.246244 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:27:41.246334 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.246303 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:27:41.640074 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.640042 2569 generic.go:358] "Generic (PLEG): container finished" podID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerID="c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8" exitCode=0 May 31 17:27:41.640074 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.640067 2569 generic.go:358] "Generic (PLEG): container finished" podID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerID="2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874" exitCode=0 May 31 17:27:41.640074 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.640074 2569 generic.go:358] "Generic (PLEG): container finished" podID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerID="b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a" exitCode=0 May 31 17:27:41.640074 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.640080 2569 generic.go:358] "Generic (PLEG): container finished" podID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerID="bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4" exitCode=0 May 31 17:27:41.640327 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.640118 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerDied","Data":"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8"} May 31 17:27:41.640327 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.640154 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerDied","Data":"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874"} May 31 17:27:41.640327 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.640164 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerDied","Data":"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a"} May 31 17:27:41.640327 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:41.640175 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerDied","Data":"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4"} May 31 17:27:42.106763 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.106738 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.213853 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.213744 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-cluster-tls-config\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.213853 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.213794 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-tls-assets\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.213853 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.213815 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kgg6\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-kube-api-access-9kgg6\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.213853 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.213835 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-metrics-client-ca\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214177 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.213978 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-volume\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214177 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214033 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214177 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214082 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214177 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214115 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-main-db\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214194 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-trusted-ca-bundle\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214233 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-out\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214274 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-web-config\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214193 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:27:42.214423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214318 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214347 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy\") pod \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\" (UID: \"1f709ab2-c675-466e-9c1b-c8f09bf91a1f\") " May 31 17:27:42.214840 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214553 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:27:42.214900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214868 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-metrics-client-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.214900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214888 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-main-db\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.214998 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.214938 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:27:42.217731 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.217678 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-volume" (OuterVolumeSpecName: "config-volume") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:42.217885 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.217774 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-out" (OuterVolumeSpecName: "config-out") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:27:42.217885 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.217857 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:42.218023 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.217954 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:42.218023 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.217970 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:27:42.218339 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.218310 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:42.218689 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.218668 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-kube-api-access-9kgg6" (OuterVolumeSpecName: "kube-api-access-9kgg6") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "kube-api-access-9kgg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:27:42.219045 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.219025 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:42.222219 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.222187 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:42.230295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.230260 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-web-config" (OuterVolumeSpecName: "web-config") pod "1f709ab2-c675-466e-9c1b-c8f09bf91a1f" (UID: "1f709ab2-c675-466e-9c1b-c8f09bf91a1f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:42.316021 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.315976 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316021 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316009 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-cluster-tls-config\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316021 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316020 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-tls-assets\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316021 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316029 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kgg6\" (UniqueName: \"kubernetes.io/projected/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-kube-api-access-9kgg6\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316344 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316038 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316344 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316047 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316344 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316057 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-main-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316344 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316066 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316344 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316075 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-config-out\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316344 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316084 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-web-config\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.316344 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.316091 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f709ab2-c675-466e-9c1b-c8f09bf91a1f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:42.651254 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.651211 2569 generic.go:358] "Generic (PLEG): container finished" podID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerID="da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d" exitCode=0 May 31 17:27:42.651254 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.651237 2569 generic.go:358] "Generic (PLEG): container finished" podID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerID="9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c" exitCode=0 May 31 17:27:42.651474 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.651263 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerDied","Data":"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d"} May 31 17:27:42.651474 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.651291 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerDied","Data":"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c"} May 31 17:27:42.651474 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.651306 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f709ab2-c675-466e-9c1b-c8f09bf91a1f","Type":"ContainerDied","Data":"613a325144aa3a610b2ed1954415a60be80cbf5a16b5e276a3ab59f0d4cee241"} May 31 17:27:42.651474 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.651321 2569 scope.go:117] "RemoveContainer" containerID="c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8" May 31 17:27:42.651474 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.651326 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.660360 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.660339 2569 scope.go:117] "RemoveContainer" containerID="da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d" May 31 17:27:42.667643 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.667626 2569 scope.go:117] "RemoveContainer" containerID="2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874" May 31 17:27:42.675381 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.675344 2569 scope.go:117] "RemoveContainer" containerID="9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c" May 31 17:27:42.678097 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.678063 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:27:42.684148 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.684115 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:27:42.687293 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.687256 2569 scope.go:117] "RemoveContainer" containerID="b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a" May 31 17:27:42.695314 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.695288 2569 scope.go:117] "RemoveContainer" containerID="bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4" May 31 17:27:42.702415 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.702395 2569 scope.go:117] "RemoveContainer" containerID="6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b" May 31 17:27:42.709623 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.709602 2569 scope.go:117] "RemoveContainer" containerID="c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8" May 31 17:27:42.710016 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:42.709984 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8\": container with ID starting with c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8 not found: ID does not exist" containerID="c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8" May 31 17:27:42.710110 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.710028 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8"} err="failed to get container status \"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8\": rpc error: code = NotFound desc = could not find container \"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8\": container with ID starting with c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8 not found: ID does not exist" May 31 17:27:42.710110 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.710058 2569 scope.go:117] "RemoveContainer" containerID="da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d" May 31 17:27:42.710369 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:42.710345 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d\": container with ID starting with da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d not found: ID does not exist" containerID="da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d" May 31 17:27:42.710446 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.710376 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d"} err="failed to get container status \"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d\": rpc error: code = NotFound desc = could not find container \"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d\": container with ID starting with da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d not found: ID does not exist" May 31 17:27:42.710446 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.710396 2569 scope.go:117] "RemoveContainer" containerID="2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874" May 31 17:27:42.710715 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:42.710692 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874\": container with ID starting with 2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874 not found: ID does not exist" containerID="2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874" May 31 17:27:42.710785 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.710724 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874"} err="failed to get container status \"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874\": rpc error: code = NotFound desc = could not find container \"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874\": container with ID starting with 2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874 not found: ID does not exist" May 31 17:27:42.710785 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.710740 2569 scope.go:117] "RemoveContainer" containerID="9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c" May 31 17:27:42.711036 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:42.711011 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c\": container with ID starting with 9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c not found: ID does not exist" containerID="9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c" May 31 17:27:42.711156 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711041 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c"} err="failed to get container status \"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c\": rpc error: code = NotFound desc = could not find container \"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c\": container with ID starting with 9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c not found: ID does not exist" May 31 17:27:42.711156 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711062 2569 scope.go:117] "RemoveContainer" containerID="b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a" May 31 17:27:42.711355 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:42.711321 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a\": container with ID starting with b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a not found: ID does not exist" containerID="b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a" May 31 17:27:42.711445 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711349 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a"} err="failed to get container status \"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a\": rpc error: code = NotFound desc = could not find container \"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a\": container with ID starting with b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a not found: ID does not exist" May 31 17:27:42.711445 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711370 2569 scope.go:117] "RemoveContainer" containerID="bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4" May 31 17:27:42.711685 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711664 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:27:42.711758 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:42.711689 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4\": container with ID starting with bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4 not found: ID does not exist" containerID="bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4" May 31 17:27:42.711758 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711719 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4"} err="failed to get container status \"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4\": rpc error: code = NotFound desc = could not find container \"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4\": container with ID starting with bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4 not found: ID does not exist" May 31 17:27:42.711758 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711737 2569 scope.go:117] "RemoveContainer" containerID="6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b" May 31 17:27:42.711957 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:42.711938 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b\": container with ID starting with 6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b not found: ID does not exist" containerID="6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b" May 31 17:27:42.712021 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711965 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b"} err="failed to get container status \"6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b\": rpc error: code = NotFound desc = could not find container \"6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b\": container with ID starting with 6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b not found: ID does not exist" May 31 17:27:42.712021 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.711986 2569 scope.go:117] "RemoveContainer" containerID="c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8" May 31 17:27:42.712021 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712011 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="init-config-reloader" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712023 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="init-config-reloader" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712031 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712037 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712044 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy-metric" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712050 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy-metric" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712073 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="prom-label-proxy" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712079 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="prom-label-proxy" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712090 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy-web" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712099 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy-web" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712109 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="config-reloader" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712118 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="config-reloader" May 31 17:27:42.712139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712139 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="alertmanager" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712146 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="alertmanager" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712202 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy-metric" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712203 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8"} err="failed to get container status \"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8\": rpc error: code = NotFound desc = could not find container \"c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8\": container with ID starting with c131a8c96b750d93b2bc00baf7d1d8645f259a1badc82355c794fe98710161b8 not found: ID does not exist" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712215 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="alertmanager" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712219 2569 scope.go:117] "RemoveContainer" containerID="da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712223 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="config-reloader" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712230 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy-web" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712237 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="kube-rbac-proxy" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712243 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" containerName="prom-label-proxy" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712446 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d"} err="failed to get container status \"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d\": rpc error: code = NotFound desc = could not find container \"da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d\": container with ID starting with da15d32f5718088163761db62583c01310817456e4e47fe21da0a144c6110f1d not found: ID does not exist" May 31 17:27:42.712568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712459 2569 scope.go:117] "RemoveContainer" containerID="2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874" May 31 17:27:42.712961 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712651 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874"} err="failed to get container status \"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874\": rpc error: code = NotFound desc = could not find container \"2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874\": container with ID starting with 2c531ab9b617d50177066bc1e57a2840ed3903a37cfe1096e189289d323f7874 not found: ID does not exist" May 31 17:27:42.712961 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712667 2569 scope.go:117] "RemoveContainer" containerID="9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c" May 31 17:27:42.712961 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712885 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c"} err="failed to get container status \"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c\": rpc error: code = NotFound desc = could not find container \"9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c\": container with ID starting with 9fb3d90b07ffb56cb31e8febbab8ca987a4e9c0d29eefa5133f47f07e4d02c3c not found: ID does not exist" May 31 17:27:42.712961 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.712897 2569 scope.go:117] "RemoveContainer" containerID="b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a" May 31 17:27:42.713150 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.713090 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a"} err="failed to get container status \"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a\": rpc error: code = NotFound desc = could not find container \"b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a\": container with ID starting with b12a02f5d07d47fa9d9e987c35503dbe0dc00124a7677c431f68866b35fc1a1a not found: ID does not exist" May 31 17:27:42.713150 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.713108 2569 scope.go:117] "RemoveContainer" containerID="bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4" May 31 17:27:42.713322 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.713306 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4"} err="failed to get container status \"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4\": rpc error: code = NotFound desc = could not find container \"bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4\": container with ID starting with bf59baff2f823ae40a726a66800a53ba9100a55d3b289efcddbb23e1300fc8e4 not found: ID does not exist" May 31 17:27:42.713371 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.713321 2569 scope.go:117] "RemoveContainer" containerID="6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b" May 31 17:27:42.713550 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.713526 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b"} err="failed to get container status \"6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b\": rpc error: code = NotFound desc = could not find container \"6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b\": container with ID starting with 6cbb83926043dfccb9d654f41c95e41e44bb68e22d6c056ec9f82fcd685d8a1b not found: ID does not exist" May 31 17:27:42.717908 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.717887 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.720638 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.720612 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 31 17:27:42.720732 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.720642 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 31 17:27:42.720732 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.720657 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 31 17:27:42.720968 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.720950 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ktpv2\"" May 31 17:27:42.721044 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.720969 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 31 17:27:42.721044 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.720952 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 31 17:27:42.721147 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.720971 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 31 17:27:42.721439 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.721419 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 31 17:27:42.721593 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.721449 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 31 17:27:42.726813 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.726428 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 31 17:27:42.728385 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.728360 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:27:42.820623 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.820565 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-web-config\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.820802 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.820674 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4qh2\" (UniqueName: \"kubernetes.io/projected/2e2a0d43-279e-4ccb-bdad-294c35166037-kube-api-access-w4qh2\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.820802 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.820705 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e2a0d43-279e-4ccb-bdad-294c35166037-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.820802 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.820737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.820802 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.820764 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e2a0d43-279e-4ccb-bdad-294c35166037-config-out\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.821009 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.820874 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e2a0d43-279e-4ccb-bdad-294c35166037-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.821009 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.820930 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e2a0d43-279e-4ccb-bdad-294c35166037-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.821009 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.820972 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.821009 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.821000 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e2a0d43-279e-4ccb-bdad-294c35166037-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.821197 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.821035 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.821197 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.821065 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.821197 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.821090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.821197 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.821136 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.921997 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922090 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922037 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-web-config\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922184 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4qh2\" (UniqueName: \"kubernetes.io/projected/2e2a0d43-279e-4ccb-bdad-294c35166037-kube-api-access-w4qh2\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922224 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e2a0d43-279e-4ccb-bdad-294c35166037-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922263 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922450 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922300 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e2a0d43-279e-4ccb-bdad-294c35166037-config-out\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922450 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922347 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e2a0d43-279e-4ccb-bdad-294c35166037-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922450 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922385 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e2a0d43-279e-4ccb-bdad-294c35166037-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922450 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922423 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922450 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922448 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e2a0d43-279e-4ccb-bdad-294c35166037-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922742 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922482 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922742 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922543 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.922742 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922579 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.923053 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.922839 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e2a0d43-279e-4ccb-bdad-294c35166037-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.923520 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.923467 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e2a0d43-279e-4ccb-bdad-294c35166037-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.924294 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.924270 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e2a0d43-279e-4ccb-bdad-294c35166037-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.925583 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.925475 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.925583 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.925521 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.925946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.925753 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-web-config\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.925946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.925814 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.925946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.925834 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.926101 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.925977 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e2a0d43-279e-4ccb-bdad-294c35166037-config-out\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.926101 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.926033 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e2a0d43-279e-4ccb-bdad-294c35166037-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.926901 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.926873 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.927726 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.927703 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e2a0d43-279e-4ccb-bdad-294c35166037-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:42.931890 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:42.931867 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4qh2\" (UniqueName: \"kubernetes.io/projected/2e2a0d43-279e-4ccb-bdad-294c35166037-kube-api-access-w4qh2\") pod \"alertmanager-main-0\" (UID: \"2e2a0d43-279e-4ccb-bdad-294c35166037\") " pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:43.030694 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:43.030656 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 31 17:27:43.172523 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:43.172473 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 31 17:27:43.174353 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:27:43.174325 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2a0d43_279e_4ccb_bdad_294c35166037.slice/crio-c03f27b4efe5f260378435e1de51106252dab0ea40c7c02ee038e052dfdd16b1 WatchSource:0}: Error finding container c03f27b4efe5f260378435e1de51106252dab0ea40c7c02ee038e052dfdd16b1: Status 404 returned error can't find the container with id c03f27b4efe5f260378435e1de51106252dab0ea40c7c02ee038e052dfdd16b1 May 31 17:27:43.656477 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:43.656443 2569 generic.go:358] "Generic (PLEG): container finished" podID="2e2a0d43-279e-4ccb-bdad-294c35166037" containerID="7c0518b9ba22d837d17f8628b380627b1c17af3ddb7541dc3d45ff9a34b8cc14" exitCode=0 May 31 17:27:43.656661 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:43.656526 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e2a0d43-279e-4ccb-bdad-294c35166037","Type":"ContainerDied","Data":"7c0518b9ba22d837d17f8628b380627b1c17af3ddb7541dc3d45ff9a34b8cc14"} May 31 17:27:43.656661 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:43.656560 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e2a0d43-279e-4ccb-bdad-294c35166037","Type":"ContainerStarted","Data":"c03f27b4efe5f260378435e1de51106252dab0ea40c7c02ee038e052dfdd16b1"} May 31 17:27:43.757966 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:43.757933 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f709ab2-c675-466e-9c1b-c8f09bf91a1f" path="/var/lib/kubelet/pods/1f709ab2-c675-466e-9c1b-c8f09bf91a1f/volumes" May 31 17:27:44.662862 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:44.662827 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e2a0d43-279e-4ccb-bdad-294c35166037","Type":"ContainerStarted","Data":"bca6c7c70326fc6df317628eefeefb381f4e6e000a8fc5dd6680584236517957"} May 31 17:27:44.662862 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:44.662867 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e2a0d43-279e-4ccb-bdad-294c35166037","Type":"ContainerStarted","Data":"5aaf46581d8b7591be4bc5dd8abf5da8c5a4cea74df9e9fa7c4c05e2dcffae32"} May 31 17:27:44.662862 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:44.662878 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e2a0d43-279e-4ccb-bdad-294c35166037","Type":"ContainerStarted","Data":"9344283db7500b0d8a5618781ec7c7a244cb5f5aac67a04f82a29a747878bb82"} May 31 17:27:44.663294 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:44.662887 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e2a0d43-279e-4ccb-bdad-294c35166037","Type":"ContainerStarted","Data":"491009f126b3357e903b98dc977dfcf858162b252927895d907344bfa8da1380"} May 31 17:27:44.663294 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:44.662895 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e2a0d43-279e-4ccb-bdad-294c35166037","Type":"ContainerStarted","Data":"e9f7212c131838b5de7aa595242b7c34860889cccf8e2faa642aad90915fcd96"} May 31 17:27:44.663294 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:44.662903 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e2a0d43-279e-4ccb-bdad-294c35166037","Type":"ContainerStarted","Data":"8aabcdcf9f649dfc814ac39a81a693bfcdf02b6644c359276841e76b81e4da2e"} May 31 17:27:44.689385 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:44.689323 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.689288794 podStartE2EDuration="2.689288794s" podCreationTimestamp="2026-05-31 17:27:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:27:44.687354266 +0000 UTC m=+273.531981281" watchObservedRunningTime="2026-05-31 17:27:44.689288794 +0000 UTC m=+273.533915812" May 31 17:27:45.162979 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.162940 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:27:45.163420 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.163389 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="prometheus" containerID="cri-o://89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" gracePeriod=600 May 31 17:27:45.163547 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.163416 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="config-reloader" containerID="cri-o://8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" gracePeriod=600 May 31 17:27:45.163547 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.163441 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy-web" containerID="cri-o://001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" gracePeriod=600 May 31 17:27:45.163547 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.163456 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" gracePeriod=600 May 31 17:27:45.163547 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.163382 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy" containerID="cri-o://049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" gracePeriod=600 May 31 17:27:45.163547 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.163389 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="thanos-sidecar" containerID="cri-o://82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" gracePeriod=600 May 31 17:27:45.418178 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.418102 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.554067 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554025 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-config-out\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554236 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554080 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-tls-assets\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554236 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554108 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-web-config\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554236 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554130 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-grpc-tls\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554236 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554160 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjsb2\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-kube-api-access-mjsb2\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554236 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554188 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-tls\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554236 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554226 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554263 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-rulefiles-0\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554291 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554352 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-metrics-client-ca\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554380 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-trusted-ca-bundle\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554414 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-metrics-client-certs\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554452 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-config\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554526 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-kube-rbac-proxy\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554592 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554556 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-db\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554943 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554598 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-thanos-prometheus-http-client-file\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554943 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554624 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-kubelet-serving-ca-bundle\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.554943 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.554652 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-serving-certs-ca-bundle\") pod \"57688b42-168b-4c20-9785-325d9893d45d\" (UID: \"57688b42-168b-4c20-9785-325d9893d45d\") " May 31 17:27:45.555091 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.555021 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:27:45.555233 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.555211 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:27:45.555516 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.555470 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:27:45.557062 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.557012 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-config-out" (OuterVolumeSpecName: "config-out") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:27:45.557171 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.557104 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-kube-api-access-mjsb2" (OuterVolumeSpecName: "kube-api-access-mjsb2") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "kube-api-access-mjsb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:27:45.557610 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.557372 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:27:45.557610 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.557467 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.557772 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.557661 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.557845 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.557822 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.558959 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.558735 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.559054 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.559015 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:27:45.559160 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.559132 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:27:45.559461 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.559436 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.559575 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.559443 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:27:45.559873 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.559764 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-config" (OuterVolumeSpecName: "config") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.559873 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.559842 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.560111 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.560091 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.569954 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.569922 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-web-config" (OuterVolumeSpecName: "web-config") pod "57688b42-168b-4c20-9785-325d9893d45d" (UID: "57688b42-168b-4c20-9785-325d9893d45d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:27:45.655621 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655577 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655621 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655613 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655621 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655625 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-metrics-client-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655634 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655647 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-metrics-client-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655656 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-config\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655666 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-kube-rbac-proxy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655676 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-prometheus-k8s-db\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655685 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655694 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655705 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57688b42-168b-4c20-9785-325d9893d45d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655714 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57688b42-168b-4c20-9785-325d9893d45d-config-out\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655722 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-tls-assets\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655730 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-web-config\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655738 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-grpc-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655746 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjsb2\" (UniqueName: \"kubernetes.io/projected/57688b42-168b-4c20-9785-325d9893d45d-kube-api-access-mjsb2\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655754 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.655847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.655763 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57688b42-168b-4c20-9785-325d9893d45d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:27:45.669359 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669274 2569 generic.go:358] "Generic (PLEG): container finished" podID="57688b42-168b-4c20-9785-325d9893d45d" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" exitCode=0 May 31 17:27:45.669359 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669301 2569 generic.go:358] "Generic (PLEG): container finished" podID="57688b42-168b-4c20-9785-325d9893d45d" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" exitCode=0 May 31 17:27:45.669359 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669308 2569 generic.go:358] "Generic (PLEG): container finished" podID="57688b42-168b-4c20-9785-325d9893d45d" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" exitCode=0 May 31 17:27:45.669359 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669315 2569 generic.go:358] "Generic (PLEG): container finished" podID="57688b42-168b-4c20-9785-325d9893d45d" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" exitCode=0 May 31 17:27:45.669359 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669321 2569 generic.go:358] "Generic (PLEG): container finished" podID="57688b42-168b-4c20-9785-325d9893d45d" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" exitCode=0 May 31 17:27:45.669359 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669326 2569 generic.go:358] "Generic (PLEG): container finished" podID="57688b42-168b-4c20-9785-325d9893d45d" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" exitCode=0 May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669353 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerDied","Data":"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae"} May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669393 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerDied","Data":"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6"} May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669403 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerDied","Data":"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2"} May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669412 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerDied","Data":"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e"} May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669423 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerDied","Data":"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035"} May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669432 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerDied","Data":"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152"} May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669435 2569 scope.go:117] "RemoveContainer" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669444 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.669900 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.669442 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57688b42-168b-4c20-9785-325d9893d45d","Type":"ContainerDied","Data":"d176e2ae0503cd3b06956f66778ec3474cf7b8ddf334a851b0dd682fa93fe75e"} May 31 17:27:45.677014 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.676996 2569 scope.go:117] "RemoveContainer" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" May 31 17:27:45.684323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.684304 2569 scope.go:117] "RemoveContainer" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" May 31 17:27:45.691518 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.691473 2569 scope.go:117] "RemoveContainer" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" May 31 17:27:45.694310 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.694287 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:27:45.697980 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.697954 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:27:45.700328 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.700310 2569 scope.go:117] "RemoveContainer" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" May 31 17:27:45.707023 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.707004 2569 scope.go:117] "RemoveContainer" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" May 31 17:27:45.714414 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.714391 2569 scope.go:117] "RemoveContainer" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" May 31 17:27:45.723841 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.723812 2569 scope.go:117] "RemoveContainer" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" May 31 17:27:45.724381 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:45.724359 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": container with ID starting with 50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae not found: ID does not exist" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" May 31 17:27:45.724457 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.724391 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae"} err="failed to get container status \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": rpc error: code = NotFound desc = could not find container \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": container with ID starting with 50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae not found: ID does not exist" May 31 17:27:45.724457 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.724411 2569 scope.go:117] "RemoveContainer" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" May 31 17:27:45.724711 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:45.724689 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": container with ID starting with 049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6 not found: ID does not exist" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" May 31 17:27:45.724759 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.724717 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6"} err="failed to get container status \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": rpc error: code = NotFound desc = could not find container \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": container with ID starting with 049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6 not found: ID does not exist" May 31 17:27:45.724759 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.724734 2569 scope.go:117] "RemoveContainer" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" May 31 17:27:45.725011 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:45.724989 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": container with ID starting with 001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2 not found: ID does not exist" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" May 31 17:27:45.725109 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.725013 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2"} err="failed to get container status \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": rpc error: code = NotFound desc = could not find container \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": container with ID starting with 001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2 not found: ID does not exist" May 31 17:27:45.725109 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.725029 2569 scope.go:117] "RemoveContainer" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" May 31 17:27:45.725278 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:45.725262 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": container with ID starting with 82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e not found: ID does not exist" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" May 31 17:27:45.725334 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.725285 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e"} err="failed to get container status \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": rpc error: code = NotFound desc = could not find container \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": container with ID starting with 82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e not found: ID does not exist" May 31 17:27:45.725334 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.725307 2569 scope.go:117] "RemoveContainer" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" May 31 17:27:45.725639 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:45.725620 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": container with ID starting with 8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035 not found: ID does not exist" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" May 31 17:27:45.725721 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.725642 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035"} err="failed to get container status \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": rpc error: code = NotFound desc = could not find container \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": container with ID starting with 8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035 not found: ID does not exist" May 31 17:27:45.725721 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.725656 2569 scope.go:117] "RemoveContainer" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" May 31 17:27:45.725864 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:45.725848 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": container with ID starting with 89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152 not found: ID does not exist" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" May 31 17:27:45.725898 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.725867 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152"} err="failed to get container status \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": rpc error: code = NotFound desc = could not find container \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": container with ID starting with 89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152 not found: ID does not exist" May 31 17:27:45.725898 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.725879 2569 scope.go:117] "RemoveContainer" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" May 31 17:27:45.726063 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:45.726049 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": container with ID starting with fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a not found: ID does not exist" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" May 31 17:27:45.726108 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.726064 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a"} err="failed to get container status \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": rpc error: code = NotFound desc = could not find container \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": container with ID starting with fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a not found: ID does not exist" May 31 17:27:45.726108 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.726078 2569 scope.go:117] "RemoveContainer" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" May 31 17:27:45.726233 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.726218 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae"} err="failed to get container status \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": rpc error: code = NotFound desc = could not find container \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": container with ID starting with 50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae not found: ID does not exist" May 31 17:27:45.726276 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.726234 2569 scope.go:117] "RemoveContainer" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" May 31 17:27:45.726568 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.726549 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6"} err="failed to get container status \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": rpc error: code = NotFound desc = could not find container \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": container with ID starting with 049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6 not found: ID does not exist" May 31 17:27:45.726624 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.726569 2569 scope.go:117] "RemoveContainer" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" May 31 17:27:45.726864 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.726844 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2"} err="failed to get container status \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": rpc error: code = NotFound desc = could not find container \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": container with ID starting with 001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2 not found: ID does not exist" May 31 17:27:45.726938 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.726866 2569 scope.go:117] "RemoveContainer" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" May 31 17:27:45.727095 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727081 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e"} err="failed to get container status \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": rpc error: code = NotFound desc = could not find container \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": container with ID starting with 82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e not found: ID does not exist" May 31 17:27:45.727144 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727097 2569 scope.go:117] "RemoveContainer" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" May 31 17:27:45.727296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727278 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035"} err="failed to get container status \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": rpc error: code = NotFound desc = could not find container \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": container with ID starting with 8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035 not found: ID does not exist" May 31 17:27:45.727335 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727298 2569 scope.go:117] "RemoveContainer" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" May 31 17:27:45.727526 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727482 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152"} err="failed to get container status \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": rpc error: code = NotFound desc = could not find container \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": container with ID starting with 89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152 not found: ID does not exist" May 31 17:27:45.727599 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727528 2569 scope.go:117] "RemoveContainer" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" May 31 17:27:45.727729 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727712 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a"} err="failed to get container status \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": rpc error: code = NotFound desc = could not find container \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": container with ID starting with fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a not found: ID does not exist" May 31 17:27:45.727770 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727729 2569 scope.go:117] "RemoveContainer" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" May 31 17:27:45.727935 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727911 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae"} err="failed to get container status \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": rpc error: code = NotFound desc = could not find container \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": container with ID starting with 50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae not found: ID does not exist" May 31 17:27:45.727935 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.727934 2569 scope.go:117] "RemoveContainer" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" May 31 17:27:45.728103 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728087 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6"} err="failed to get container status \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": rpc error: code = NotFound desc = could not find container \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": container with ID starting with 049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6 not found: ID does not exist" May 31 17:27:45.728148 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728103 2569 scope.go:117] "RemoveContainer" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" May 31 17:27:45.728300 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728274 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2"} err="failed to get container status \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": rpc error: code = NotFound desc = could not find container \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": container with ID starting with 001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2 not found: ID does not exist" May 31 17:27:45.728300 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728299 2569 scope.go:117] "RemoveContainer" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" May 31 17:27:45.728473 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728455 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e"} err="failed to get container status \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": rpc error: code = NotFound desc = could not find container \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": container with ID starting with 82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e not found: ID does not exist" May 31 17:27:45.728545 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728476 2569 scope.go:117] "RemoveContainer" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" May 31 17:27:45.728689 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728670 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035"} err="failed to get container status \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": rpc error: code = NotFound desc = could not find container \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": container with ID starting with 8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035 not found: ID does not exist" May 31 17:27:45.728729 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728690 2569 scope.go:117] "RemoveContainer" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" May 31 17:27:45.728863 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728847 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152"} err="failed to get container status \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": rpc error: code = NotFound desc = could not find container \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": container with ID starting with 89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152 not found: ID does not exist" May 31 17:27:45.728906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.728863 2569 scope.go:117] "RemoveContainer" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" May 31 17:27:45.729047 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729033 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a"} err="failed to get container status \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": rpc error: code = NotFound desc = could not find container \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": container with ID starting with fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a not found: ID does not exist" May 31 17:27:45.729091 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729047 2569 scope.go:117] "RemoveContainer" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" May 31 17:27:45.729275 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729256 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae"} err="failed to get container status \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": rpc error: code = NotFound desc = could not find container \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": container with ID starting with 50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae not found: ID does not exist" May 31 17:27:45.729343 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729276 2569 scope.go:117] "RemoveContainer" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" May 31 17:27:45.729471 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729452 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6"} err="failed to get container status \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": rpc error: code = NotFound desc = could not find container \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": container with ID starting with 049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6 not found: ID does not exist" May 31 17:27:45.729586 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729471 2569 scope.go:117] "RemoveContainer" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" May 31 17:27:45.729662 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729646 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2"} err="failed to get container status \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": rpc error: code = NotFound desc = could not find container \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": container with ID starting with 001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2 not found: ID does not exist" May 31 17:27:45.729662 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729661 2569 scope.go:117] "RemoveContainer" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" May 31 17:27:45.729846 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729827 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e"} err="failed to get container status \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": rpc error: code = NotFound desc = could not find container \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": container with ID starting with 82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e not found: ID does not exist" May 31 17:27:45.729905 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.729849 2569 scope.go:117] "RemoveContainer" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" May 31 17:27:45.730046 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730031 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035"} err="failed to get container status \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": rpc error: code = NotFound desc = could not find container \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": container with ID starting with 8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035 not found: ID does not exist" May 31 17:27:45.730093 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730046 2569 scope.go:117] "RemoveContainer" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" May 31 17:27:45.730222 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730208 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152"} err="failed to get container status \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": rpc error: code = NotFound desc = could not find container \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": container with ID starting with 89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152 not found: ID does not exist" May 31 17:27:45.730271 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730222 2569 scope.go:117] "RemoveContainer" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" May 31 17:27:45.730406 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730372 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a"} err="failed to get container status \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": rpc error: code = NotFound desc = could not find container \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": container with ID starting with fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a not found: ID does not exist" May 31 17:27:45.730406 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730397 2569 scope.go:117] "RemoveContainer" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" May 31 17:27:45.730615 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730597 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae"} err="failed to get container status \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": rpc error: code = NotFound desc = could not find container \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": container with ID starting with 50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae not found: ID does not exist" May 31 17:27:45.730669 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730615 2569 scope.go:117] "RemoveContainer" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" May 31 17:27:45.730807 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730786 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6"} err="failed to get container status \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": rpc error: code = NotFound desc = could not find container \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": container with ID starting with 049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6 not found: ID does not exist" May 31 17:27:45.730845 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730806 2569 scope.go:117] "RemoveContainer" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" May 31 17:27:45.731014 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.730998 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2"} err="failed to get container status \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": rpc error: code = NotFound desc = could not find container \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": container with ID starting with 001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2 not found: ID does not exist" May 31 17:27:45.731061 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731014 2569 scope.go:117] "RemoveContainer" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" May 31 17:27:45.731211 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731193 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e"} err="failed to get container status \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": rpc error: code = NotFound desc = could not find container \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": container with ID starting with 82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e not found: ID does not exist" May 31 17:27:45.731260 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731211 2569 scope.go:117] "RemoveContainer" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" May 31 17:27:45.731409 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731393 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035"} err="failed to get container status \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": rpc error: code = NotFound desc = could not find container \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": container with ID starting with 8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035 not found: ID does not exist" May 31 17:27:45.731452 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731411 2569 scope.go:117] "RemoveContainer" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" May 31 17:27:45.731634 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731618 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152"} err="failed to get container status \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": rpc error: code = NotFound desc = could not find container \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": container with ID starting with 89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152 not found: ID does not exist" May 31 17:27:45.731684 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731634 2569 scope.go:117] "RemoveContainer" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" May 31 17:27:45.731846 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731829 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a"} err="failed to get container status \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": rpc error: code = NotFound desc = could not find container \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": container with ID starting with fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a not found: ID does not exist" May 31 17:27:45.731911 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.731848 2569 scope.go:117] "RemoveContainer" containerID="50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae" May 31 17:27:45.732069 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732042 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae"} err="failed to get container status \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": rpc error: code = NotFound desc = could not find container \"50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae\": container with ID starting with 50b599b54bed57f29c813d3b3487a39399c7c7b64539b8e6adc801fa216a09ae not found: ID does not exist" May 31 17:27:45.732069 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732061 2569 scope.go:117] "RemoveContainer" containerID="049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6" May 31 17:27:45.732247 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732228 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6"} err="failed to get container status \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": rpc error: code = NotFound desc = could not find container \"049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6\": container with ID starting with 049c29ddd86f9d84c659f0d0481727ea84b3ea63afaccb327ad2bc9c3cb634c6 not found: ID does not exist" May 31 17:27:45.732300 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732248 2569 scope.go:117] "RemoveContainer" containerID="001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2" May 31 17:27:45.732431 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732416 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2"} err="failed to get container status \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": rpc error: code = NotFound desc = could not find container \"001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2\": container with ID starting with 001e3fc7bdf3ba2b912e9a554ce8f9b66e736c5a83dde606504bfdfee61af4b2 not found: ID does not exist" May 31 17:27:45.732475 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732431 2569 scope.go:117] "RemoveContainer" containerID="82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e" May 31 17:27:45.732635 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732620 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e"} err="failed to get container status \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": rpc error: code = NotFound desc = could not find container \"82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e\": container with ID starting with 82f171e44c7b87c70d9a4ad0e81cfb2ab54281714a0490cbee25174dd5abaf1e not found: ID does not exist" May 31 17:27:45.732687 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732636 2569 scope.go:117] "RemoveContainer" containerID="8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035" May 31 17:27:45.732826 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732809 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035"} err="failed to get container status \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": rpc error: code = NotFound desc = could not find container \"8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035\": container with ID starting with 8fdf05681c4984c9f13b1f14eebf2062c4c758b340731988d2424ea0bc445035 not found: ID does not exist" May 31 17:27:45.732861 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.732827 2569 scope.go:117] "RemoveContainer" containerID="89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152" May 31 17:27:45.733044 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.733028 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152"} err="failed to get container status \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": rpc error: code = NotFound desc = could not find container \"89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152\": container with ID starting with 89c1734e0e4e2a20e3d1479addcf5766e2c061f8076cf4c61511d57b39a36152 not found: ID does not exist" May 31 17:27:45.733044 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.733044 2569 scope.go:117] "RemoveContainer" containerID="fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a" May 31 17:27:45.733248 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.733233 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a"} err="failed to get container status \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": rpc error: code = NotFound desc = could not find container \"fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a\": container with ID starting with fd931dd81ac038e7804d362f0d18dd49f6b66179d4910b755285078445e4304a not found: ID does not exist" May 31 17:27:45.751079 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751042 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:27:45.751428 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751411 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy" May 31 17:27:45.751544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751431 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy" May 31 17:27:45.751544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751446 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy-web" May 31 17:27:45.751544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751454 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy-web" May 31 17:27:45.751544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751464 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy-thanos" May 31 17:27:45.751544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751473 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy-thanos" May 31 17:27:45.751544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751519 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="prometheus" May 31 17:27:45.751544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751528 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="prometheus" May 31 17:27:45.751544 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751541 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="init-config-reloader" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751549 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="init-config-reloader" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751559 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="config-reloader" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751567 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="config-reloader" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751581 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="thanos-sidecar" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751589 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="thanos-sidecar" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751696 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="prometheus" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751709 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy-web" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751721 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="config-reloader" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751730 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="thanos-sidecar" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751740 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy" May 31 17:27:45.751926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.751751 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="57688b42-168b-4c20-9785-325d9893d45d" containerName="kube-rbac-proxy-thanos" May 31 17:27:45.757594 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.757566 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.760574 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.760544 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 31 17:27:45.760733 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.760549 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 31 17:27:45.760733 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.760550 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 31 17:27:45.760733 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.760549 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 31 17:27:45.760733 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.760670 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 31 17:27:45.760950 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.760624 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 31 17:27:45.760950 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.760798 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fdwrh\"" May 31 17:27:45.761368 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.761342 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 31 17:27:45.761471 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.761391 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 31 17:27:45.761471 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.761450 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 31 17:27:45.761612 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.761468 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 31 17:27:45.761806 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.761790 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 31 17:27:45.761880 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.761811 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-60pdo6j198o6k\"" May 31 17:27:45.762873 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.762849 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57688b42-168b-4c20-9785-325d9893d45d" path="/var/lib/kubelet/pods/57688b42-168b-4c20-9785-325d9893d45d/volumes" May 31 17:27:45.764847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.764828 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 31 17:27:45.768023 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.768005 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 31 17:27:45.770841 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.770819 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:27:45.858346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.858307 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.858346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.858345 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.858582 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.858382 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae06d9a-803a-479b-933a-b08125f26eb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.858582 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.858404 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.858582 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.858422 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.858672 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.858440 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.858923 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859018 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859139 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmv5\" (UniqueName: \"kubernetes.io/projected/9ae06d9a-803a-479b-933a-b08125f26eb9-kube-api-access-jsmv5\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859180 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859239 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859288 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859390 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-config\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859444 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859480 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.863194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.859546 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae06d9a-803a-479b-933a-b08125f26eb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960651 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960541 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960651 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960600 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960651 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960632 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmv5\" (UniqueName: \"kubernetes.io/projected/9ae06d9a-803a-479b-933a-b08125f26eb9-kube-api-access-jsmv5\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960662 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960686 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960713 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960741 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960769 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-config\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960814 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960847 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960873 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae06d9a-803a-479b-933a-b08125f26eb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.960922 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960910 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.961323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960935 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.961323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.960982 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae06d9a-803a-479b-933a-b08125f26eb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.961323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.961017 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.961323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.961043 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.961323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.961072 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.961323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.961134 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.961323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.961208 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.961697 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.961566 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.962714 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.962687 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.963931 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.963897 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae06d9a-803a-479b-933a-b08125f26eb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.964040 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.963911 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.964107 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.964058 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.964107 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.964087 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.964639 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.964298 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.964639 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.964388 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae06d9a-803a-479b-933a-b08125f26eb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.964639 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.964549 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.964639 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.964605 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-config\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.964946 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.964708 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.966439 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.966417 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.966579 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.966423 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ae06d9a-803a-479b-933a-b08125f26eb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.966637 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.966574 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.966675 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.966656 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.966732 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.966715 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae06d9a-803a-479b-933a-b08125f26eb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:45.969202 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:45.969184 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmv5\" (UniqueName: \"kubernetes.io/projected/9ae06d9a-803a-479b-933a-b08125f26eb9-kube-api-access-jsmv5\") pod \"prometheus-k8s-0\" (UID: \"9ae06d9a-803a-479b-933a-b08125f26eb9\") " pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:46.069423 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:46.069384 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:46.206569 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:46.206166 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 31 17:27:46.208853 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:27:46.208829 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae06d9a_803a_479b_933a_b08125f26eb9.slice/crio-15eddc9807fc372fe3c290d97007776c8c731281dc9249d8ecd06c892a18682b WatchSource:0}: Error finding container 15eddc9807fc372fe3c290d97007776c8c731281dc9249d8ecd06c892a18682b: Status 404 returned error can't find the container with id 15eddc9807fc372fe3c290d97007776c8c731281dc9249d8ecd06c892a18682b May 31 17:27:46.675439 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:46.675400 2569 generic.go:358] "Generic (PLEG): container finished" podID="9ae06d9a-803a-479b-933a-b08125f26eb9" containerID="42e646c3bc7fe2e3feda85948934517520c54edbbe178382a5e439df1997ce7d" exitCode=0 May 31 17:27:46.675898 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:46.675466 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ae06d9a-803a-479b-933a-b08125f26eb9","Type":"ContainerDied","Data":"42e646c3bc7fe2e3feda85948934517520c54edbbe178382a5e439df1997ce7d"} May 31 17:27:46.675898 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:46.675522 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ae06d9a-803a-479b-933a-b08125f26eb9","Type":"ContainerStarted","Data":"15eddc9807fc372fe3c290d97007776c8c731281dc9249d8ecd06c892a18682b"} May 31 17:27:47.681168 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:47.681132 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ae06d9a-803a-479b-933a-b08125f26eb9","Type":"ContainerStarted","Data":"176150b0e2652aa2ee477c21f95234349893360898834b37f3bb5f022739d428"} May 31 17:27:47.681168 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:47.681169 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ae06d9a-803a-479b-933a-b08125f26eb9","Type":"ContainerStarted","Data":"307ca3048673c57a10f697bf7fe27f35410edde1d509ce568799b7076560cfa3"} May 31 17:27:47.681577 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:47.681178 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ae06d9a-803a-479b-933a-b08125f26eb9","Type":"ContainerStarted","Data":"672bd48b77c2da993671925b33218eff00ddf33925dd11e9da7866a7b7398be0"} May 31 17:27:47.681577 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:47.681187 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ae06d9a-803a-479b-933a-b08125f26eb9","Type":"ContainerStarted","Data":"a48363a01ffcfd4f736c80492b54ec10b253ee4256f450827f09bb9dceff40c3"} May 31 17:27:47.681577 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:47.681196 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ae06d9a-803a-479b-933a-b08125f26eb9","Type":"ContainerStarted","Data":"580e975231170adc1e9b5d78a310f609c59b9b9038bf1b3f0ad18fb109e09d45"} May 31 17:27:47.681577 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:47.681206 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ae06d9a-803a-479b-933a-b08125f26eb9","Type":"ContainerStarted","Data":"18ce457cf6fdc75153862c7c3724c3a004dd5f1c5462a089e5fd4bafdecebad5"} May 31 17:27:47.709862 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:47.709771 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7097452410000002 podStartE2EDuration="2.709745241s" podCreationTimestamp="2026-05-31 17:27:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:27:47.70830877 +0000 UTC m=+276.552935786" watchObservedRunningTime="2026-05-31 17:27:47.709745241 +0000 UTC m=+276.554372255" May 31 17:27:48.571017 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:48.570978 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:27:48.571170 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:48.571033 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:27:51.070108 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:51.070065 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:27:51.245599 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:51.245562 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:27:51.245748 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:51.245617 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:27:51.245748 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:51.245655 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:27:51.246134 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:51.246106 2569 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"baf69e6cbd70c067751fb2f4e62a4bf27978eb0a10ce9d2ffb869bb68b308a44"} pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" containerMessage="Container registry failed liveness probe, will be restarted" May 31 17:27:51.249309 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:51.249285 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:27:51.249530 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:51.249325 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:27:52.246278 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:52.246233 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-9kf44" podUID="45b5735c-7b24-4029-a4a7-ef51191f5985" May 31 17:27:52.246684 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:27:52.246280 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zmkvc" podUID="864ff596-a523-4c11-a9bf-f0f15940074f" May 31 17:27:52.695046 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:52.695016 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:27:52.695239 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:52.695080 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmkvc" May 31 17:27:55.452457 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.452398 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:27:55.452457 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.452471 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:27:55.454887 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.454865 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/864ff596-a523-4c11-a9bf-f0f15940074f-metrics-tls\") pod \"dns-default-zmkvc\" (UID: \"864ff596-a523-4c11-a9bf-f0f15940074f\") " pod="openshift-dns/dns-default-zmkvc" May 31 17:27:55.455015 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.454994 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45b5735c-7b24-4029-a4a7-ef51191f5985-cert\") pod \"ingress-canary-9kf44\" (UID: \"45b5735c-7b24-4029-a4a7-ef51191f5985\") " pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:27:55.699139 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.699102 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p8png\"" May 31 17:27:55.699911 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.699893 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-777ll\"" May 31 17:27:55.707140 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.707060 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9kf44" May 31 17:27:55.707140 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.707083 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmkvc" May 31 17:27:55.856657 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.856629 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9kf44"] May 31 17:27:55.858576 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:27:55.858548 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b5735c_7b24_4029_a4a7_ef51191f5985.slice/crio-d30740bbdd25035f971015c9e4624099abfb5652b6b0af950f4a9d51f60ecd11 WatchSource:0}: Error finding container d30740bbdd25035f971015c9e4624099abfb5652b6b0af950f4a9d51f60ecd11: Status 404 returned error can't find the container with id d30740bbdd25035f971015c9e4624099abfb5652b6b0af950f4a9d51f60ecd11 May 31 17:27:55.879798 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:55.879772 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zmkvc"] May 31 17:27:55.882291 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:27:55.882259 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod864ff596_a523_4c11_a9bf_f0f15940074f.slice/crio-138ac51f5e488f07b28f69b7d26b835387f4c7e56fdae50a97528d59988a7a76 WatchSource:0}: Error finding container 138ac51f5e488f07b28f69b7d26b835387f4c7e56fdae50a97528d59988a7a76: Status 404 returned error can't find the container with id 138ac51f5e488f07b28f69b7d26b835387f4c7e56fdae50a97528d59988a7a76 May 31 17:27:56.711143 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:56.711099 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9kf44" event={"ID":"45b5735c-7b24-4029-a4a7-ef51191f5985","Type":"ContainerStarted","Data":"d30740bbdd25035f971015c9e4624099abfb5652b6b0af950f4a9d51f60ecd11"} May 31 17:27:56.713134 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:56.712724 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmkvc" event={"ID":"864ff596-a523-4c11-a9bf-f0f15940074f","Type":"ContainerStarted","Data":"138ac51f5e488f07b28f69b7d26b835387f4c7e56fdae50a97528d59988a7a76"} May 31 17:27:58.720089 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:58.720043 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9kf44" event={"ID":"45b5735c-7b24-4029-a4a7-ef51191f5985","Type":"ContainerStarted","Data":"81998858df0aa49d42d5da7a405d619b777d3c3630c9bb4061270db4b8177da2"} May 31 17:27:58.721698 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:58.721663 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmkvc" event={"ID":"864ff596-a523-4c11-a9bf-f0f15940074f","Type":"ContainerStarted","Data":"11881bcaf688488e1f0ecf380f40dd521ee480448039a7b8d31a4f2689c63d9b"} May 31 17:27:58.721698 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:58.721694 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmkvc" event={"ID":"864ff596-a523-4c11-a9bf-f0f15940074f","Type":"ContainerStarted","Data":"702f5f1808c14bb78f534777d334ed0cc5a874a4372447d7d1f21042ae66e534"} May 31 17:27:58.721861 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:58.721818 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zmkvc" May 31 17:27:58.740722 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:58.740660 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9kf44" podStartSLOduration=251.874898271 podStartE2EDuration="4m13.740646592s" podCreationTimestamp="2026-05-31 17:23:45 +0000 UTC" firstStartedPulling="2026-05-31 17:27:55.860585199 +0000 UTC m=+284.705212192" lastFinishedPulling="2026-05-31 17:27:57.726333521 +0000 UTC m=+286.570960513" observedRunningTime="2026-05-31 17:27:58.739208255 +0000 UTC m=+287.583835274" watchObservedRunningTime="2026-05-31 17:27:58.740646592 +0000 UTC m=+287.585273601" May 31 17:27:58.757646 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:27:58.757588 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-zmkvc" podStartSLOduration=251.919454359 podStartE2EDuration="4m13.757568143s" podCreationTimestamp="2026-05-31 17:23:45 +0000 UTC" firstStartedPulling="2026-05-31 17:27:55.884137638 +0000 UTC m=+284.728764630" lastFinishedPulling="2026-05-31 17:27:57.722251422 +0000 UTC m=+286.566878414" observedRunningTime="2026-05-31 17:27:58.755612674 +0000 UTC m=+287.600239689" watchObservedRunningTime="2026-05-31 17:27:58.757568143 +0000 UTC m=+287.602195160" May 31 17:28:01.250238 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:01.250200 2569 patch_prober.go:28] interesting pod/image-registry-6cf6765bfc-fkwxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:28:01.250615 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:01.250256 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:28:08.726923 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:08.726892 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zmkvc" May 31 17:28:11.249647 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:11.249615 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:28:11.676172 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:11.676145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:28:11.676400 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:11.676376 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:28:11.680122 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:11.680101 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:28:11.680246 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:11.680109 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:28:11.686384 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:11.686362 2569 kubelet.go:1628] "Image garbage collection succeeded" May 31 17:28:16.265728 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:16.265679 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" podUID="f31f2e11-eade-4751-8f02-720253feed81" containerName="registry" containerID="cri-o://baf69e6cbd70c067751fb2f4e62a4bf27978eb0a10ce9d2ffb869bb68b308a44" gracePeriod=30 May 31 17:28:17.385076 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:17.385052 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 17:28:17.779617 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:17.779580 2569 generic.go:358] "Generic (PLEG): container finished" podID="f31f2e11-eade-4751-8f02-720253feed81" containerID="baf69e6cbd70c067751fb2f4e62a4bf27978eb0a10ce9d2ffb869bb68b308a44" exitCode=0 May 31 17:28:17.779816 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:17.779647 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" event={"ID":"f31f2e11-eade-4751-8f02-720253feed81","Type":"ContainerDied","Data":"baf69e6cbd70c067751fb2f4e62a4bf27978eb0a10ce9d2ffb869bb68b308a44"} May 31 17:28:17.779816 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:17.779674 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" event={"ID":"f31f2e11-eade-4751-8f02-720253feed81","Type":"ContainerStarted","Data":"3e456ce0b5e7342fbfe8f681a139ceaf96b807ec9ab5b6c28c67beccfd069fde"} May 31 17:28:17.779816 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:17.779689 2569 scope.go:117] "RemoveContainer" containerID="21ea8be405747ca50e09bf7b37f48b608014a612599b7edb59e76512d7224286" May 31 17:28:17.779816 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:17.779757 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:28:38.788966 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:38.788937 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cf6765bfc-fkwxz" May 31 17:28:46.070442 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:46.070400 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:28:46.087080 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:46.087052 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:28:46.888570 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:28:46.888540 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 31 17:29:19.210101 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.210020 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rmgk9"] May 31 17:29:19.212974 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.212956 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.215614 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.215594 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 31 17:29:19.221756 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.221728 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rmgk9"] May 31 17:29:19.304157 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.304119 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/748902ec-c9e7-44d5-8eba-e428e8c8d38c-original-pull-secret\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.304157 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.304163 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/748902ec-c9e7-44d5-8eba-e428e8c8d38c-kubelet-config\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.304368 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.304203 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/748902ec-c9e7-44d5-8eba-e428e8c8d38c-dbus\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.404776 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.404737 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/748902ec-c9e7-44d5-8eba-e428e8c8d38c-original-pull-secret\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.404776 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.404775 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/748902ec-c9e7-44d5-8eba-e428e8c8d38c-kubelet-config\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.404964 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.404805 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/748902ec-c9e7-44d5-8eba-e428e8c8d38c-dbus\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.404964 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.404886 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/748902ec-c9e7-44d5-8eba-e428e8c8d38c-kubelet-config\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.405031 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.404982 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/748902ec-c9e7-44d5-8eba-e428e8c8d38c-dbus\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.407278 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.407245 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/748902ec-c9e7-44d5-8eba-e428e8c8d38c-original-pull-secret\") pod \"global-pull-secret-syncer-rmgk9\" (UID: \"748902ec-c9e7-44d5-8eba-e428e8c8d38c\") " pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.523146 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.523058 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmgk9" May 31 17:29:19.653608 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.653578 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rmgk9"] May 31 17:29:19.656415 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:29:19.656378 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748902ec_c9e7_44d5_8eba_e428e8c8d38c.slice/crio-a128b9f94840ac73587c50a74aec201eec7cd11ca9e1d73313005b4f8ab25da1 WatchSource:0}: Error finding container a128b9f94840ac73587c50a74aec201eec7cd11ca9e1d73313005b4f8ab25da1: Status 404 returned error can't find the container with id a128b9f94840ac73587c50a74aec201eec7cd11ca9e1d73313005b4f8ab25da1 May 31 17:29:19.971101 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:19.971061 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rmgk9" event={"ID":"748902ec-c9e7-44d5-8eba-e428e8c8d38c","Type":"ContainerStarted","Data":"a128b9f94840ac73587c50a74aec201eec7cd11ca9e1d73313005b4f8ab25da1"} May 31 17:29:23.985112 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:23.985071 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rmgk9" event={"ID":"748902ec-c9e7-44d5-8eba-e428e8c8d38c","Type":"ContainerStarted","Data":"9aa7c080ce5fee251b3551a7336d6bc69eaaafefee0328eae0b45f8b0870307d"} May 31 17:29:24.016847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:29:24.016790 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rmgk9" podStartSLOduration=1.23540737 podStartE2EDuration="5.016769266s" podCreationTimestamp="2026-05-31 17:29:19 +0000 UTC" firstStartedPulling="2026-05-31 17:29:19.658324162 +0000 UTC m=+368.502951156" lastFinishedPulling="2026-05-31 17:29:23.439686051 +0000 UTC m=+372.284313052" observedRunningTime="2026-05-31 17:29:24.015941631 +0000 UTC m=+372.860568647" watchObservedRunningTime="2026-05-31 17:29:24.016769266 +0000 UTC m=+372.861396280" May 31 17:31:06.676347 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.676308 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd"] May 31 17:31:06.678764 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.678744 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.682191 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.682163 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 31 17:31:06.682362 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.682269 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 31 17:31:06.682362 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.682280 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 31 17:31:06.682522 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.682400 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 31 17:31:06.682721 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.682698 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hqdxb\"" May 31 17:31:06.697124 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.697090 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd"] May 31 17:31:06.762133 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.762090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.762332 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.762158 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.762332 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.762196 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-tmp\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.762332 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.762223 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-manifests\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.762332 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.762290 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjvmn\" (UniqueName: \"kubernetes.io/projected/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-kube-api-access-mjvmn\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.863281 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.863237 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-manifests\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.863478 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.863307 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjvmn\" (UniqueName: \"kubernetes.io/projected/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-kube-api-access-mjvmn\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.863478 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.863340 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.863478 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.863378 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.863478 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.863419 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-tmp\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.863760 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.863718 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-manifests\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.866005 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.865980 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-tmp\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.866212 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.866193 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.866257 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.866208 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.874116 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.874084 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjvmn\" (UniqueName: \"kubernetes.io/projected/4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5-kube-api-access-mjvmn\") pod \"opendatahub-operator-controller-manager-cd7c7f585-xjgdd\" (UID: \"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:06.989787 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:06.989687 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:07.140182 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:07.140145 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd"] May 31 17:31:07.143593 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:31:07.143563 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb7d736_b2cf_4544_b7f0_d5bcd0b584f5.slice/crio-3cdb34fa9bfd5ffbf4fc35788008fa0e7e2ff69e913f930d7cfa9338b4ed1dd6 WatchSource:0}: Error finding container 3cdb34fa9bfd5ffbf4fc35788008fa0e7e2ff69e913f930d7cfa9338b4ed1dd6: Status 404 returned error can't find the container with id 3cdb34fa9bfd5ffbf4fc35788008fa0e7e2ff69e913f930d7cfa9338b4ed1dd6 May 31 17:31:07.298310 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:07.298224 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" event={"ID":"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5","Type":"ContainerStarted","Data":"3cdb34fa9bfd5ffbf4fc35788008fa0e7e2ff69e913f930d7cfa9338b4ed1dd6"} May 31 17:31:10.310554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:10.310445 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" event={"ID":"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5","Type":"ContainerStarted","Data":"075eadfc146d8c257a00b0aa95ba0e2d33ac34944ec43800052b929510d0d9b9"} May 31 17:31:11.324140 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:11.324038 2569 generic.go:358] "Generic (PLEG): container finished" podID="4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5" containerID="075eadfc146d8c257a00b0aa95ba0e2d33ac34944ec43800052b929510d0d9b9" exitCode=0 May 31 17:31:11.324140 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:11.324105 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" event={"ID":"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5","Type":"ContainerDied","Data":"075eadfc146d8c257a00b0aa95ba0e2d33ac34944ec43800052b929510d0d9b9"} May 31 17:31:12.328850 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:12.328806 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" event={"ID":"4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5","Type":"ContainerStarted","Data":"fdd0c483ee66ba920570fee93d305808155284b35223489f50050f3d7d1ed379"} May 31 17:31:12.329320 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:12.328898 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:12.353080 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:12.352986 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" podStartSLOduration=1.89637419 podStartE2EDuration="6.352968614s" podCreationTimestamp="2026-05-31 17:31:06 +0000 UTC" firstStartedPulling="2026-05-31 17:31:07.145252439 +0000 UTC m=+475.989879432" lastFinishedPulling="2026-05-31 17:31:11.60184686 +0000 UTC m=+480.446473856" observedRunningTime="2026-05-31 17:31:12.35110255 +0000 UTC m=+481.195729565" watchObservedRunningTime="2026-05-31 17:31:12.352968614 +0000 UTC m=+481.197595683" May 31 17:31:23.333860 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:23.333818 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-xjgdd" May 31 17:31:24.984149 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:24.984109 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f"] May 31 17:31:24.994205 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:24.994173 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:24.997561 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:24.997530 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 31 17:31:24.997710 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:24.997545 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 31 17:31:24.998435 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:24.998410 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 31 17:31:24.998702 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:24.998665 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 31 17:31:24.998702 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:24.998698 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 31 17:31:24.998832 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:24.998814 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-67g6g\"" May 31 17:31:25.005962 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.005936 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f"] May 31 17:31:25.125846 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.125811 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mt98\" (UniqueName: \"kubernetes.io/projected/7804d1a5-7603-4a06-9047-27eddc4258fa-kube-api-access-8mt98\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.125846 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.125860 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7804d1a5-7603-4a06-9047-27eddc4258fa-metrics-cert\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.126066 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.125923 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7804d1a5-7603-4a06-9047-27eddc4258fa-cert\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.126066 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.125950 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7804d1a5-7603-4a06-9047-27eddc4258fa-manager-config\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.227002 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.226951 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7804d1a5-7603-4a06-9047-27eddc4258fa-cert\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.227002 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.227006 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7804d1a5-7603-4a06-9047-27eddc4258fa-manager-config\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.227218 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.227080 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mt98\" (UniqueName: \"kubernetes.io/projected/7804d1a5-7603-4a06-9047-27eddc4258fa-kube-api-access-8mt98\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.227218 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.227124 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7804d1a5-7603-4a06-9047-27eddc4258fa-metrics-cert\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.227894 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.227818 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7804d1a5-7603-4a06-9047-27eddc4258fa-manager-config\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.229702 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.229673 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7804d1a5-7603-4a06-9047-27eddc4258fa-cert\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.229859 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.229838 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7804d1a5-7603-4a06-9047-27eddc4258fa-metrics-cert\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.240004 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.239946 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mt98\" (UniqueName: \"kubernetes.io/projected/7804d1a5-7603-4a06-9047-27eddc4258fa-kube-api-access-8mt98\") pod \"lws-controller-manager-85597f657c-8gs2f\" (UID: \"7804d1a5-7603-4a06-9047-27eddc4258fa\") " pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.304876 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.304835 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:25.510388 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.510308 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f"] May 31 17:31:25.513581 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:31:25.513551 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7804d1a5_7603_4a06_9047_27eddc4258fa.slice/crio-062369f4526b644f7357ee5414d81a1d4b4a4d4d1f0bae4e91c1294184c597d8 WatchSource:0}: Error finding container 062369f4526b644f7357ee5414d81a1d4b4a4d4d1f0bae4e91c1294184c597d8: Status 404 returned error can't find the container with id 062369f4526b644f7357ee5414d81a1d4b4a4d4d1f0bae4e91c1294184c597d8 May 31 17:31:25.895528 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.895475 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2"] May 31 17:31:25.899042 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.899013 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:25.901884 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.901853 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 31 17:31:25.902019 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.901853 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jsm22\"" May 31 17:31:25.902019 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.902002 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 31 17:31:25.903204 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.903185 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 31 17:31:25.903331 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.903207 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 31 17:31:25.922222 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:25.922194 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2"] May 31 17:31:26.035802 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.035769 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-tls-certs\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.036191 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.035860 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxb9\" (UniqueName: \"kubernetes.io/projected/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-kube-api-access-ccxb9\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.036191 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.035896 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-tmp\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.136640 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.136599 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxb9\" (UniqueName: \"kubernetes.io/projected/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-kube-api-access-ccxb9\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.136844 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.136665 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-tmp\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.136844 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.136710 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-tls-certs\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.139065 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.139036 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-tmp\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.139325 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.139303 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-tls-certs\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.148548 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.148459 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxb9\" (UniqueName: \"kubernetes.io/projected/0219d9a7-f752-442a-a6e4-db5c5b6d75bc-kube-api-access-ccxb9\") pod \"kube-auth-proxy-6ccddbf6bf-6ggp2\" (UID: \"0219d9a7-f752-442a-a6e4-db5c5b6d75bc\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.209464 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.209435 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" May 31 17:31:26.376617 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.376558 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2"] May 31 17:31:26.386312 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:31:26.384442 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0219d9a7_f752_442a_a6e4_db5c5b6d75bc.slice/crio-eab82f9725f742a8722c090fda87f04ae321f976b942568326c2cba40992deec WatchSource:0}: Error finding container eab82f9725f742a8722c090fda87f04ae321f976b942568326c2cba40992deec: Status 404 returned error can't find the container with id eab82f9725f742a8722c090fda87f04ae321f976b942568326c2cba40992deec May 31 17:31:26.386312 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:26.385229 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" event={"ID":"7804d1a5-7603-4a06-9047-27eddc4258fa","Type":"ContainerStarted","Data":"062369f4526b644f7357ee5414d81a1d4b4a4d4d1f0bae4e91c1294184c597d8"} May 31 17:31:27.391356 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:27.391314 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" event={"ID":"0219d9a7-f752-442a-a6e4-db5c5b6d75bc","Type":"ContainerStarted","Data":"eab82f9725f742a8722c090fda87f04ae321f976b942568326c2cba40992deec"} May 31 17:31:30.404522 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:30.404465 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" event={"ID":"0219d9a7-f752-442a-a6e4-db5c5b6d75bc","Type":"ContainerStarted","Data":"7d6b4261801afc70317877b9a24910d0415a99f36c24a2b16827b1239d5d044c"} May 31 17:31:30.405846 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:30.405818 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" event={"ID":"7804d1a5-7603-4a06-9047-27eddc4258fa","Type":"ContainerStarted","Data":"aa10870d9c30fbe413b0b25e226a44a206725bf8e25000a0e5ccd5694b02d49c"} May 31 17:31:30.405967 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:30.405953 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:31:30.422449 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:30.422400 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-6ggp2" podStartSLOduration=2.087527945 podStartE2EDuration="5.422387451s" podCreationTimestamp="2026-05-31 17:31:25 +0000 UTC" firstStartedPulling="2026-05-31 17:31:26.388034567 +0000 UTC m=+495.232661560" lastFinishedPulling="2026-05-31 17:31:29.722894071 +0000 UTC m=+498.567521066" observedRunningTime="2026-05-31 17:31:30.421413989 +0000 UTC m=+499.266041004" watchObservedRunningTime="2026-05-31 17:31:30.422387451 +0000 UTC m=+499.267014496" May 31 17:31:30.438196 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:30.438137 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" podStartSLOduration=2.276088691 podStartE2EDuration="6.438117004s" podCreationTimestamp="2026-05-31 17:31:24 +0000 UTC" firstStartedPulling="2026-05-31 17:31:25.515329084 +0000 UTC m=+494.359956077" lastFinishedPulling="2026-05-31 17:31:29.677357386 +0000 UTC m=+498.521984390" observedRunningTime="2026-05-31 17:31:30.436223332 +0000 UTC m=+499.280850347" watchObservedRunningTime="2026-05-31 17:31:30.438117004 +0000 UTC m=+499.282744022" May 31 17:31:41.412064 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:31:41.412034 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85597f657c-8gs2f" May 31 17:33:03.010557 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.010520 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s"] May 31 17:33:03.013861 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.013841 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" May 31 17:33:03.017551 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.017528 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pgwmb\"" May 31 17:33:03.018186 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.018169 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 31 17:33:03.018680 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.018659 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 31 17:33:03.018763 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.018707 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 31 17:33:03.031269 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.031244 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s"] May 31 17:33:03.127777 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.127731 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nflk\" (UniqueName: \"kubernetes.io/projected/fedca97f-433d-490a-a70f-004b943aa3f0-kube-api-access-4nflk\") pod \"dns-operator-controller-manager-648d5c98bc-qh99s\" (UID: \"fedca97f-433d-490a-a70f-004b943aa3f0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" May 31 17:33:03.229097 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.229047 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nflk\" (UniqueName: \"kubernetes.io/projected/fedca97f-433d-490a-a70f-004b943aa3f0-kube-api-access-4nflk\") pod \"dns-operator-controller-manager-648d5c98bc-qh99s\" (UID: \"fedca97f-433d-490a-a70f-004b943aa3f0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" May 31 17:33:03.251025 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.250991 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nflk\" (UniqueName: \"kubernetes.io/projected/fedca97f-433d-490a-a70f-004b943aa3f0-kube-api-access-4nflk\") pod \"dns-operator-controller-manager-648d5c98bc-qh99s\" (UID: \"fedca97f-433d-490a-a70f-004b943aa3f0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" May 31 17:33:03.324022 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.323924 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" May 31 17:33:03.472925 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.472898 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s"] May 31 17:33:03.476226 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:33:03.476196 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedca97f_433d_490a_a70f_004b943aa3f0.slice/crio-e6c0083affdd09e769f01ca251afd33c9415a0cacd1884b8955e8293891f503c WatchSource:0}: Error finding container e6c0083affdd09e769f01ca251afd33c9415a0cacd1884b8955e8293891f503c: Status 404 returned error can't find the container with id e6c0083affdd09e769f01ca251afd33c9415a0cacd1884b8955e8293891f503c May 31 17:33:03.725581 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:03.725540 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" event={"ID":"fedca97f-433d-490a-a70f-004b943aa3f0","Type":"ContainerStarted","Data":"e6c0083affdd09e769f01ca251afd33c9415a0cacd1884b8955e8293891f503c"} May 31 17:33:06.739982 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:06.739942 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" event={"ID":"fedca97f-433d-490a-a70f-004b943aa3f0","Type":"ContainerStarted","Data":"3dec1fdd4fbc19ffa34754846cbfb515431f977ba0ec8967148a5aa4ba7321a8"} May 31 17:33:06.740384 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:06.740054 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" May 31 17:33:06.768044 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:06.767977 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" podStartSLOduration=2.436518498 podStartE2EDuration="4.767958209s" podCreationTimestamp="2026-05-31 17:33:02 +0000 UTC" firstStartedPulling="2026-05-31 17:33:03.478740855 +0000 UTC m=+592.323367848" lastFinishedPulling="2026-05-31 17:33:05.810180565 +0000 UTC m=+594.654807559" observedRunningTime="2026-05-31 17:33:06.76680671 +0000 UTC m=+595.611433723" watchObservedRunningTime="2026-05-31 17:33:06.767958209 +0000 UTC m=+595.612585228" May 31 17:33:09.396453 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.396414 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-njddp"] May 31 17:33:09.400313 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.400288 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-njddp" May 31 17:33:09.405719 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.405696 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zzq7b\"" May 31 17:33:09.415250 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.415225 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-njddp"] May 31 17:33:09.486113 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.486073 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f49s\" (UniqueName: \"kubernetes.io/projected/ba7406d8-d6c4-4f62-bf11-f1a19a14a90b-kube-api-access-8f49s\") pod \"authorino-operator-657f44b778-njddp\" (UID: \"ba7406d8-d6c4-4f62-bf11-f1a19a14a90b\") " pod="kuadrant-system/authorino-operator-657f44b778-njddp" May 31 17:33:09.587633 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.587593 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8f49s\" (UniqueName: \"kubernetes.io/projected/ba7406d8-d6c4-4f62-bf11-f1a19a14a90b-kube-api-access-8f49s\") pod \"authorino-operator-657f44b778-njddp\" (UID: \"ba7406d8-d6c4-4f62-bf11-f1a19a14a90b\") " pod="kuadrant-system/authorino-operator-657f44b778-njddp" May 31 17:33:09.597644 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.597618 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f49s\" (UniqueName: \"kubernetes.io/projected/ba7406d8-d6c4-4f62-bf11-f1a19a14a90b-kube-api-access-8f49s\") pod \"authorino-operator-657f44b778-njddp\" (UID: \"ba7406d8-d6c4-4f62-bf11-f1a19a14a90b\") " pod="kuadrant-system/authorino-operator-657f44b778-njddp" May 31 17:33:09.713039 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.712956 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-njddp" May 31 17:33:09.847056 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:09.846891 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-njddp"] May 31 17:33:09.849961 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:33:09.849930 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7406d8_d6c4_4f62_bf11_f1a19a14a90b.slice/crio-79f29e3d338bb027768000a62195173be46721cd54db5fc08f2eeefb2161f0be WatchSource:0}: Error finding container 79f29e3d338bb027768000a62195173be46721cd54db5fc08f2eeefb2161f0be: Status 404 returned error can't find the container with id 79f29e3d338bb027768000a62195173be46721cd54db5fc08f2eeefb2161f0be May 31 17:33:10.756563 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:10.756527 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-njddp" event={"ID":"ba7406d8-d6c4-4f62-bf11-f1a19a14a90b","Type":"ContainerStarted","Data":"79f29e3d338bb027768000a62195173be46721cd54db5fc08f2eeefb2161f0be"} May 31 17:33:11.960149 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:11.960124 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:33:11.960695 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:11.960676 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:33:11.963975 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:11.963954 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:33:11.964701 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:11.964676 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:33:12.772250 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:12.772214 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-njddp" event={"ID":"ba7406d8-d6c4-4f62-bf11-f1a19a14a90b","Type":"ContainerStarted","Data":"02de1ad90d10ec7eba4b76a03068c95c720fd6fd8b6e204ff714d3010094dcca"} May 31 17:33:12.772428 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:12.772334 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-njddp" May 31 17:33:12.800735 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:12.800689 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-njddp" podStartSLOduration=1.654518285 podStartE2EDuration="3.800673036s" podCreationTimestamp="2026-05-31 17:33:09 +0000 UTC" firstStartedPulling="2026-05-31 17:33:09.852114908 +0000 UTC m=+598.696741920" lastFinishedPulling="2026-05-31 17:33:11.998269675 +0000 UTC m=+600.842896671" observedRunningTime="2026-05-31 17:33:12.797912713 +0000 UTC m=+601.642539729" watchObservedRunningTime="2026-05-31 17:33:12.800673036 +0000 UTC m=+601.645300052" May 31 17:33:17.746853 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:17.746815 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qh99s" May 31 17:33:23.778017 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:33:23.777979 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-njddp" May 31 17:34:04.791311 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:04.791274 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c4sws"] May 31 17:34:04.795223 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:04.795202 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" May 31 17:34:04.797772 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:04.797754 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9xjh9\"" May 31 17:34:04.801348 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:04.801328 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c4sws"] May 31 17:34:04.891833 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:04.891796 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b8gv\" (UniqueName: \"kubernetes.io/projected/d5f3c868-1da0-4411-a385-e82d1b89f21a-kube-api-access-6b8gv\") pod \"authorino-f99f4b5cd-c4sws\" (UID: \"d5f3c868-1da0-4411-a385-e82d1b89f21a\") " pod="kuadrant-system/authorino-f99f4b5cd-c4sws" May 31 17:34:04.992751 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:04.992716 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b8gv\" (UniqueName: \"kubernetes.io/projected/d5f3c868-1da0-4411-a385-e82d1b89f21a-kube-api-access-6b8gv\") pod \"authorino-f99f4b5cd-c4sws\" (UID: \"d5f3c868-1da0-4411-a385-e82d1b89f21a\") " pod="kuadrant-system/authorino-f99f4b5cd-c4sws" May 31 17:34:04.998016 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:04.997988 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-8lwrj"] May 31 17:34:05.001447 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.001429 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8lwrj" May 31 17:34:05.002861 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.002839 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b8gv\" (UniqueName: \"kubernetes.io/projected/d5f3c868-1da0-4411-a385-e82d1b89f21a-kube-api-access-6b8gv\") pod \"authorino-f99f4b5cd-c4sws\" (UID: \"d5f3c868-1da0-4411-a385-e82d1b89f21a\") " pod="kuadrant-system/authorino-f99f4b5cd-c4sws" May 31 17:34:05.008762 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.008732 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-8lwrj"] May 31 17:34:05.093856 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.093819 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9jsf\" (UniqueName: \"kubernetes.io/projected/5db13f95-cb9b-46af-9c43-16efcda9e88c-kube-api-access-d9jsf\") pod \"authorino-7498df8756-8lwrj\" (UID: \"5db13f95-cb9b-46af-9c43-16efcda9e88c\") " pod="kuadrant-system/authorino-7498df8756-8lwrj" May 31 17:34:05.115736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.115700 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" May 31 17:34:05.194875 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.194841 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9jsf\" (UniqueName: \"kubernetes.io/projected/5db13f95-cb9b-46af-9c43-16efcda9e88c-kube-api-access-d9jsf\") pod \"authorino-7498df8756-8lwrj\" (UID: \"5db13f95-cb9b-46af-9c43-16efcda9e88c\") " pod="kuadrant-system/authorino-7498df8756-8lwrj" May 31 17:34:05.204716 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.204689 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9jsf\" (UniqueName: \"kubernetes.io/projected/5db13f95-cb9b-46af-9c43-16efcda9e88c-kube-api-access-d9jsf\") pod \"authorino-7498df8756-8lwrj\" (UID: \"5db13f95-cb9b-46af-9c43-16efcda9e88c\") " pod="kuadrant-system/authorino-7498df8756-8lwrj" May 31 17:34:05.247686 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.247659 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c4sws"] May 31 17:34:05.249859 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:34:05.249833 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5f3c868_1da0_4411_a385_e82d1b89f21a.slice/crio-7bbd801b506fe0572b9d94868ca2a4205308adbf8da5bb2fda36042c49b5b168 WatchSource:0}: Error finding container 7bbd801b506fe0572b9d94868ca2a4205308adbf8da5bb2fda36042c49b5b168: Status 404 returned error can't find the container with id 7bbd801b506fe0572b9d94868ca2a4205308adbf8da5bb2fda36042c49b5b168 May 31 17:34:05.251055 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.251035 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 17:34:05.319262 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.319230 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8lwrj" May 31 17:34:05.453625 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.453595 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-8lwrj"] May 31 17:34:05.455978 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:34:05.455946 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5db13f95_cb9b_46af_9c43_16efcda9e88c.slice/crio-4085fd5489a064ee9c3cadd2dab897022a71715e98d3c5b0286f086009157041 WatchSource:0}: Error finding container 4085fd5489a064ee9c3cadd2dab897022a71715e98d3c5b0286f086009157041: Status 404 returned error can't find the container with id 4085fd5489a064ee9c3cadd2dab897022a71715e98d3c5b0286f086009157041 May 31 17:34:05.951699 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.951652 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8lwrj" event={"ID":"5db13f95-cb9b-46af-9c43-16efcda9e88c","Type":"ContainerStarted","Data":"4085fd5489a064ee9c3cadd2dab897022a71715e98d3c5b0286f086009157041"} May 31 17:34:05.953680 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:05.953648 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" event={"ID":"d5f3c868-1da0-4411-a385-e82d1b89f21a","Type":"ContainerStarted","Data":"7bbd801b506fe0572b9d94868ca2a4205308adbf8da5bb2fda36042c49b5b168"} May 31 17:34:08.968921 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:08.968870 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8lwrj" event={"ID":"5db13f95-cb9b-46af-9c43-16efcda9e88c","Type":"ContainerStarted","Data":"dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3"} May 31 17:34:08.970683 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:08.970651 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" event={"ID":"d5f3c868-1da0-4411-a385-e82d1b89f21a","Type":"ContainerStarted","Data":"d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a"} May 31 17:34:08.989023 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:08.988162 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-8lwrj" podStartSLOduration=1.61745305 podStartE2EDuration="4.988143544s" podCreationTimestamp="2026-05-31 17:34:04 +0000 UTC" firstStartedPulling="2026-05-31 17:34:05.45730542 +0000 UTC m=+654.301932413" lastFinishedPulling="2026-05-31 17:34:08.827995911 +0000 UTC m=+657.672622907" observedRunningTime="2026-05-31 17:34:08.985697121 +0000 UTC m=+657.830324137" watchObservedRunningTime="2026-05-31 17:34:08.988143544 +0000 UTC m=+657.832770560" May 31 17:34:09.001977 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:09.001823 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" podStartSLOduration=1.41217905 podStartE2EDuration="5.001803818s" podCreationTimestamp="2026-05-31 17:34:04 +0000 UTC" firstStartedPulling="2026-05-31 17:34:05.251194907 +0000 UTC m=+654.095821900" lastFinishedPulling="2026-05-31 17:34:08.840819676 +0000 UTC m=+657.685446668" observedRunningTime="2026-05-31 17:34:09.001655965 +0000 UTC m=+657.846282980" watchObservedRunningTime="2026-05-31 17:34:09.001803818 +0000 UTC m=+657.846430837" May 31 17:34:09.030697 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:09.030663 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c4sws"] May 31 17:34:10.978596 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:10.978551 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" podUID="d5f3c868-1da0-4411-a385-e82d1b89f21a" containerName="authorino" containerID="cri-o://d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a" gracePeriod=30 May 31 17:34:11.219075 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.219052 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" May 31 17:34:11.256018 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.255940 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b8gv\" (UniqueName: \"kubernetes.io/projected/d5f3c868-1da0-4411-a385-e82d1b89f21a-kube-api-access-6b8gv\") pod \"d5f3c868-1da0-4411-a385-e82d1b89f21a\" (UID: \"d5f3c868-1da0-4411-a385-e82d1b89f21a\") " May 31 17:34:11.258294 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.258260 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5f3c868-1da0-4411-a385-e82d1b89f21a-kube-api-access-6b8gv" (OuterVolumeSpecName: "kube-api-access-6b8gv") pod "d5f3c868-1da0-4411-a385-e82d1b89f21a" (UID: "d5f3c868-1da0-4411-a385-e82d1b89f21a"). InnerVolumeSpecName "kube-api-access-6b8gv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:34:11.356920 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.356881 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b8gv\" (UniqueName: \"kubernetes.io/projected/d5f3c868-1da0-4411-a385-e82d1b89f21a-kube-api-access-6b8gv\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:34:11.983039 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.983007 2569 generic.go:358] "Generic (PLEG): container finished" podID="d5f3c868-1da0-4411-a385-e82d1b89f21a" containerID="d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a" exitCode=0 May 31 17:34:11.983525 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.983058 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" May 31 17:34:11.983525 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.983080 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" event={"ID":"d5f3c868-1da0-4411-a385-e82d1b89f21a","Type":"ContainerDied","Data":"d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a"} May 31 17:34:11.983525 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.983109 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-c4sws" event={"ID":"d5f3c868-1da0-4411-a385-e82d1b89f21a","Type":"ContainerDied","Data":"7bbd801b506fe0572b9d94868ca2a4205308adbf8da5bb2fda36042c49b5b168"} May 31 17:34:11.983525 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.983125 2569 scope.go:117] "RemoveContainer" containerID="d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a" May 31 17:34:11.991671 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.991653 2569 scope.go:117] "RemoveContainer" containerID="d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a" May 31 17:34:11.991932 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:34:11.991910 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a\": container with ID starting with d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a not found: ID does not exist" containerID="d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a" May 31 17:34:11.991998 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:11.991944 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a"} err="failed to get container status \"d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a\": rpc error: code = NotFound desc = could not find container \"d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a\": container with ID starting with d044eedab07c4797faa0492ff1fbf3f4259221a9344b36d960c7dc4a24b8807a not found: ID does not exist" May 31 17:34:12.000962 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:12.000934 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c4sws"] May 31 17:34:12.006323 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:12.006291 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-c4sws"] May 31 17:34:13.757340 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:13.757308 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5f3c868-1da0-4411-a385-e82d1b89f21a" path="/var/lib/kubelet/pods/d5f3c868-1da0-4411-a385-e82d1b89f21a/volumes" May 31 17:34:58.688176 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.688141 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:34:58.688679 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.688531 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f3c868-1da0-4411-a385-e82d1b89f21a" containerName="authorino" May 31 17:34:58.688679 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.688545 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f3c868-1da0-4411-a385-e82d1b89f21a" containerName="authorino" May 31 17:34:58.688679 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.688624 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5f3c868-1da0-4411-a385-e82d1b89f21a" containerName="authorino" May 31 17:34:58.692642 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.692620 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 31 17:34:58.695449 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.695431 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 31 17:34:58.695598 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.695431 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-w7bsj\"" May 31 17:34:58.695598 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.695434 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 31 17:34:58.696307 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.696292 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 31 17:34:58.700994 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.700969 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:34:58.789067 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.789033 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wnlr\" (UniqueName: \"kubernetes.io/projected/4e070310-541b-4442-8f97-deb6229711d6-kube-api-access-6wnlr\") pod \"maas-keycloak-0\" (UID: \"4e070310-541b-4442-8f97-deb6229711d6\") " pod="keycloak-system/maas-keycloak-0" May 31 17:34:58.890057 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.890019 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wnlr\" (UniqueName: \"kubernetes.io/projected/4e070310-541b-4442-8f97-deb6229711d6-kube-api-access-6wnlr\") pod \"maas-keycloak-0\" (UID: \"4e070310-541b-4442-8f97-deb6229711d6\") " pod="keycloak-system/maas-keycloak-0" May 31 17:34:58.899417 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:58.899383 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wnlr\" (UniqueName: \"kubernetes.io/projected/4e070310-541b-4442-8f97-deb6229711d6-kube-api-access-6wnlr\") pod \"maas-keycloak-0\" (UID: \"4e070310-541b-4442-8f97-deb6229711d6\") " pod="keycloak-system/maas-keycloak-0" May 31 17:34:59.003682 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:59.003563 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 31 17:34:59.141017 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:59.140827 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:34:59.143725 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:34:59.143697 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e070310_541b_4442_8f97_deb6229711d6.slice/crio-956cc8e0acc346b8f606ceffd03d0c80effa1575deb5cc728e9cb261eac32685 WatchSource:0}: Error finding container 956cc8e0acc346b8f606ceffd03d0c80effa1575deb5cc728e9cb261eac32685: Status 404 returned error can't find the container with id 956cc8e0acc346b8f606ceffd03d0c80effa1575deb5cc728e9cb261eac32685 May 31 17:34:59.153976 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:34:59.153947 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4e070310-541b-4442-8f97-deb6229711d6","Type":"ContainerStarted","Data":"956cc8e0acc346b8f606ceffd03d0c80effa1575deb5cc728e9cb261eac32685"} May 31 17:35:04.175135 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:04.175091 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4e070310-541b-4442-8f97-deb6229711d6","Type":"ContainerStarted","Data":"81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff"} May 31 17:35:04.196456 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:04.196388 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.581786924 podStartE2EDuration="6.196371195s" podCreationTimestamp="2026-05-31 17:34:58 +0000 UTC" firstStartedPulling="2026-05-31 17:34:59.14500646 +0000 UTC m=+707.989633454" lastFinishedPulling="2026-05-31 17:35:03.759590732 +0000 UTC m=+712.604217725" observedRunningTime="2026-05-31 17:35:04.194124284 +0000 UTC m=+713.038751300" watchObservedRunningTime="2026-05-31 17:35:04.196371195 +0000 UTC m=+713.040998210" May 31 17:35:05.004246 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:05.004198 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 31 17:35:05.005996 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:05.005960 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:06.004855 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:06.004801 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:07.004233 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:07.004182 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:08.004664 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:08.004606 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:09.004336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:09.004249 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 31 17:35:09.004707 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:09.004664 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:10.004644 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:10.004585 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:11.004817 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:11.004767 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:12.004086 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:12.003973 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:13.004736 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:13.004675 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:14.004289 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:14.004238 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:15.004195 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:15.004150 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:16.004629 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:16.004582 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" May 31 17:35:17.136162 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:17.136112 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 31 17:35:17.158194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:17.158087 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:35:27.144150 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:27.144116 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 31 17:35:28.014672 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.014632 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9hvmx"] May 31 17:35:28.023069 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.023036 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" May 31 17:35:28.024225 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.024196 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9hvmx"] May 31 17:35:28.079606 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.079565 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47sfg\" (UniqueName: \"kubernetes.io/projected/25fde9b1-144a-4861-8677-5ed7c5d4a36e-kube-api-access-47sfg\") pod \"authorino-8b475cf9f-9hvmx\" (UID: \"25fde9b1-144a-4861-8677-5ed7c5d4a36e\") " pod="kuadrant-system/authorino-8b475cf9f-9hvmx" May 31 17:35:28.180229 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.180187 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47sfg\" (UniqueName: \"kubernetes.io/projected/25fde9b1-144a-4861-8677-5ed7c5d4a36e-kube-api-access-47sfg\") pod \"authorino-8b475cf9f-9hvmx\" (UID: \"25fde9b1-144a-4861-8677-5ed7c5d4a36e\") " pod="kuadrant-system/authorino-8b475cf9f-9hvmx" May 31 17:35:28.188346 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.188317 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47sfg\" (UniqueName: \"kubernetes.io/projected/25fde9b1-144a-4861-8677-5ed7c5d4a36e-kube-api-access-47sfg\") pod \"authorino-8b475cf9f-9hvmx\" (UID: \"25fde9b1-144a-4861-8677-5ed7c5d4a36e\") " pod="kuadrant-system/authorino-8b475cf9f-9hvmx" May 31 17:35:28.247868 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.247825 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9hvmx"] May 31 17:35:28.248119 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.248105 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" May 31 17:35:28.276114 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.276040 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57698486fc-xwh85"] May 31 17:35:28.278771 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.278749 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57698486fc-xwh85" May 31 17:35:28.288056 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.288006 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57698486fc-xwh85"] May 31 17:35:28.382204 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.382172 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5zm8\" (UniqueName: \"kubernetes.io/projected/76a39618-06fc-4243-b8b8-d931e628922b-kube-api-access-x5zm8\") pod \"authorino-57698486fc-xwh85\" (UID: \"76a39618-06fc-4243-b8b8-d931e628922b\") " pod="kuadrant-system/authorino-57698486fc-xwh85" May 31 17:35:28.383109 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.383084 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9hvmx"] May 31 17:35:28.385852 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:35:28.385825 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25fde9b1_144a_4861_8677_5ed7c5d4a36e.slice/crio-ac06e91bb3229bf64c20eb9614d361648b1d5f7e2be85e97fa1610564fe2dea6 WatchSource:0}: Error finding container ac06e91bb3229bf64c20eb9614d361648b1d5f7e2be85e97fa1610564fe2dea6: Status 404 returned error can't find the container with id ac06e91bb3229bf64c20eb9614d361648b1d5f7e2be85e97fa1610564fe2dea6 May 31 17:35:28.453024 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.452987 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57698486fc-xwh85"] May 31 17:35:28.453273 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:35:28.453253 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-x5zm8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-57698486fc-xwh85" podUID="76a39618-06fc-4243-b8b8-d931e628922b" May 31 17:35:28.480329 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.480291 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c6c997945-jnll6"] May 31 17:35:28.482578 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.482550 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:35:28.482819 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.482792 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5zm8\" (UniqueName: \"kubernetes.io/projected/76a39618-06fc-4243-b8b8-d931e628922b-kube-api-access-x5zm8\") pod \"authorino-57698486fc-xwh85\" (UID: \"76a39618-06fc-4243-b8b8-d931e628922b\") " pod="kuadrant-system/authorino-57698486fc-xwh85" May 31 17:35:28.485461 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.485438 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 31 17:35:28.491135 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.491112 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c6c997945-jnll6"] May 31 17:35:28.493904 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.493877 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5zm8\" (UniqueName: \"kubernetes.io/projected/76a39618-06fc-4243-b8b8-d931e628922b-kube-api-access-x5zm8\") pod \"authorino-57698486fc-xwh85\" (UID: \"76a39618-06fc-4243-b8b8-d931e628922b\") " pod="kuadrant-system/authorino-57698486fc-xwh85" May 31 17:35:28.583507 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.583457 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdqxv\" (UniqueName: \"kubernetes.io/projected/7f054854-7b56-4f8b-a635-90aa37b49bdc-kube-api-access-bdqxv\") pod \"authorino-c6c997945-jnll6\" (UID: \"7f054854-7b56-4f8b-a635-90aa37b49bdc\") " pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:35:28.583665 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.583621 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7f054854-7b56-4f8b-a635-90aa37b49bdc-tls-cert\") pod \"authorino-c6c997945-jnll6\" (UID: \"7f054854-7b56-4f8b-a635-90aa37b49bdc\") " pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:35:28.684515 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.684456 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7f054854-7b56-4f8b-a635-90aa37b49bdc-tls-cert\") pod \"authorino-c6c997945-jnll6\" (UID: \"7f054854-7b56-4f8b-a635-90aa37b49bdc\") " pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:35:28.684681 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.684561 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdqxv\" (UniqueName: \"kubernetes.io/projected/7f054854-7b56-4f8b-a635-90aa37b49bdc-kube-api-access-bdqxv\") pod \"authorino-c6c997945-jnll6\" (UID: \"7f054854-7b56-4f8b-a635-90aa37b49bdc\") " pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:35:28.687040 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.687016 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7f054854-7b56-4f8b-a635-90aa37b49bdc-tls-cert\") pod \"authorino-c6c997945-jnll6\" (UID: \"7f054854-7b56-4f8b-a635-90aa37b49bdc\") " pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:35:28.693218 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.693197 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdqxv\" (UniqueName: \"kubernetes.io/projected/7f054854-7b56-4f8b-a635-90aa37b49bdc-kube-api-access-bdqxv\") pod \"authorino-c6c997945-jnll6\" (UID: \"7f054854-7b56-4f8b-a635-90aa37b49bdc\") " pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:35:28.793840 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.793811 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:35:28.934066 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:28.934033 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c6c997945-jnll6"] May 31 17:35:28.936713 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:35:28.936681 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f054854_7b56_4f8b_a635_90aa37b49bdc.slice/crio-dccd6b8e06279b396e4e06f9ea5441b0ffd8ac0c7aa577c6dc53562cba18fcce WatchSource:0}: Error finding container dccd6b8e06279b396e4e06f9ea5441b0ffd8ac0c7aa577c6dc53562cba18fcce: Status 404 returned error can't find the container with id dccd6b8e06279b396e4e06f9ea5441b0ffd8ac0c7aa577c6dc53562cba18fcce May 31 17:35:29.287102 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.287066 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c6c997945-jnll6" event={"ID":"7f054854-7b56-4f8b-a635-90aa37b49bdc","Type":"ContainerStarted","Data":"cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02"} May 31 17:35:29.287102 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.287102 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c6c997945-jnll6" event={"ID":"7f054854-7b56-4f8b-a635-90aa37b49bdc","Type":"ContainerStarted","Data":"dccd6b8e06279b396e4e06f9ea5441b0ffd8ac0c7aa577c6dc53562cba18fcce"} May 31 17:35:29.288643 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.288613 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" event={"ID":"25fde9b1-144a-4861-8677-5ed7c5d4a36e","Type":"ContainerStarted","Data":"be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740"} May 31 17:35:29.288759 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.288639 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" podUID="25fde9b1-144a-4861-8677-5ed7c5d4a36e" containerName="authorino" containerID="cri-o://be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740" gracePeriod=30 May 31 17:35:29.288759 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.288652 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57698486fc-xwh85" May 31 17:35:29.288870 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.288652 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" event={"ID":"25fde9b1-144a-4861-8677-5ed7c5d4a36e","Type":"ContainerStarted","Data":"ac06e91bb3229bf64c20eb9614d361648b1d5f7e2be85e97fa1610564fe2dea6"} May 31 17:35:29.294639 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.294617 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57698486fc-xwh85" May 31 17:35:29.302318 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.302038 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-c6c997945-jnll6" podStartSLOduration=1.034085799 podStartE2EDuration="1.302019406s" podCreationTimestamp="2026-05-31 17:35:28 +0000 UTC" firstStartedPulling="2026-05-31 17:35:28.938090267 +0000 UTC m=+737.782717261" lastFinishedPulling="2026-05-31 17:35:29.206023873 +0000 UTC m=+738.050650868" observedRunningTime="2026-05-31 17:35:29.301708772 +0000 UTC m=+738.146335787" watchObservedRunningTime="2026-05-31 17:35:29.302019406 +0000 UTC m=+738.146646434" May 31 17:35:29.334104 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.334040 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" podStartSLOduration=1.013668241 podStartE2EDuration="1.334020218s" podCreationTimestamp="2026-05-31 17:35:28 +0000 UTC" firstStartedPulling="2026-05-31 17:35:28.387542322 +0000 UTC m=+737.232169327" lastFinishedPulling="2026-05-31 17:35:28.70789431 +0000 UTC m=+737.552521304" observedRunningTime="2026-05-31 17:35:29.3268693 +0000 UTC m=+738.171496318" watchObservedRunningTime="2026-05-31 17:35:29.334020218 +0000 UTC m=+738.178647233" May 31 17:35:29.337594 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.337559 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-8lwrj"] May 31 17:35:29.337847 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.337815 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-8lwrj" podUID="5db13f95-cb9b-46af-9c43-16efcda9e88c" containerName="authorino" containerID="cri-o://dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3" gracePeriod=30 May 31 17:35:29.392308 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.392250 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5zm8\" (UniqueName: \"kubernetes.io/projected/76a39618-06fc-4243-b8b8-d931e628922b-kube-api-access-x5zm8\") pod \"76a39618-06fc-4243-b8b8-d931e628922b\" (UID: \"76a39618-06fc-4243-b8b8-d931e628922b\") " May 31 17:35:29.394581 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.394537 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a39618-06fc-4243-b8b8-d931e628922b-kube-api-access-x5zm8" (OuterVolumeSpecName: "kube-api-access-x5zm8") pod "76a39618-06fc-4243-b8b8-d931e628922b" (UID: "76a39618-06fc-4243-b8b8-d931e628922b"). InnerVolumeSpecName "kube-api-access-x5zm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:35:29.494052 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.493970 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5zm8\" (UniqueName: \"kubernetes.io/projected/76a39618-06fc-4243-b8b8-d931e628922b-kube-api-access-x5zm8\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:35:29.583929 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.583900 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" May 31 17:35:29.591173 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.591154 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8lwrj" May 31 17:35:29.695755 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.695716 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9jsf\" (UniqueName: \"kubernetes.io/projected/5db13f95-cb9b-46af-9c43-16efcda9e88c-kube-api-access-d9jsf\") pod \"5db13f95-cb9b-46af-9c43-16efcda9e88c\" (UID: \"5db13f95-cb9b-46af-9c43-16efcda9e88c\") " May 31 17:35:29.695755 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.695769 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47sfg\" (UniqueName: \"kubernetes.io/projected/25fde9b1-144a-4861-8677-5ed7c5d4a36e-kube-api-access-47sfg\") pod \"25fde9b1-144a-4861-8677-5ed7c5d4a36e\" (UID: \"25fde9b1-144a-4861-8677-5ed7c5d4a36e\") " May 31 17:35:29.698028 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.697987 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db13f95-cb9b-46af-9c43-16efcda9e88c-kube-api-access-d9jsf" (OuterVolumeSpecName: "kube-api-access-d9jsf") pod "5db13f95-cb9b-46af-9c43-16efcda9e88c" (UID: "5db13f95-cb9b-46af-9c43-16efcda9e88c"). InnerVolumeSpecName "kube-api-access-d9jsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:35:29.698146 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.698045 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25fde9b1-144a-4861-8677-5ed7c5d4a36e-kube-api-access-47sfg" (OuterVolumeSpecName: "kube-api-access-47sfg") pod "25fde9b1-144a-4861-8677-5ed7c5d4a36e" (UID: "25fde9b1-144a-4861-8677-5ed7c5d4a36e"). InnerVolumeSpecName "kube-api-access-47sfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:35:29.797520 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.797461 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9jsf\" (UniqueName: \"kubernetes.io/projected/5db13f95-cb9b-46af-9c43-16efcda9e88c-kube-api-access-d9jsf\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:35:29.797520 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:29.797522 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47sfg\" (UniqueName: \"kubernetes.io/projected/25fde9b1-144a-4861-8677-5ed7c5d4a36e-kube-api-access-47sfg\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:35:30.293250 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.293213 2569 generic.go:358] "Generic (PLEG): container finished" podID="5db13f95-cb9b-46af-9c43-16efcda9e88c" containerID="dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3" exitCode=0 May 31 17:35:30.293711 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.293261 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8lwrj" May 31 17:35:30.293711 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.293292 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8lwrj" event={"ID":"5db13f95-cb9b-46af-9c43-16efcda9e88c","Type":"ContainerDied","Data":"dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3"} May 31 17:35:30.293711 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.293324 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8lwrj" event={"ID":"5db13f95-cb9b-46af-9c43-16efcda9e88c","Type":"ContainerDied","Data":"4085fd5489a064ee9c3cadd2dab897022a71715e98d3c5b0286f086009157041"} May 31 17:35:30.293711 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.293345 2569 scope.go:117] "RemoveContainer" containerID="dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3" May 31 17:35:30.294548 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.294470 2569 generic.go:358] "Generic (PLEG): container finished" podID="25fde9b1-144a-4861-8677-5ed7c5d4a36e" containerID="be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740" exitCode=0 May 31 17:35:30.294601 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.294582 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" May 31 17:35:30.294640 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.294617 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" event={"ID":"25fde9b1-144a-4861-8677-5ed7c5d4a36e","Type":"ContainerDied","Data":"be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740"} May 31 17:35:30.294682 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.294653 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-9hvmx" event={"ID":"25fde9b1-144a-4861-8677-5ed7c5d4a36e","Type":"ContainerDied","Data":"ac06e91bb3229bf64c20eb9614d361648b1d5f7e2be85e97fa1610564fe2dea6"} May 31 17:35:30.294819 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.294764 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57698486fc-xwh85" May 31 17:35:30.302339 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.302322 2569 scope.go:117] "RemoveContainer" containerID="dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3" May 31 17:35:30.302660 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:35:30.302640 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3\": container with ID starting with dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3 not found: ID does not exist" containerID="dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3" May 31 17:35:30.302701 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.302670 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3"} err="failed to get container status \"dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3\": rpc error: code = NotFound desc = could not find container \"dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3\": container with ID starting with dc44cca16a2bfecea401f5947da11d7ba814b8d3cc4eee0e048997f592feadb3 not found: ID does not exist" May 31 17:35:30.302701 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.302688 2569 scope.go:117] "RemoveContainer" containerID="be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740" May 31 17:35:30.310477 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.310456 2569 scope.go:117] "RemoveContainer" containerID="be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740" May 31 17:35:30.310792 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:35:30.310774 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740\": container with ID starting with be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740 not found: ID does not exist" containerID="be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740" May 31 17:35:30.310839 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.310799 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740"} err="failed to get container status \"be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740\": rpc error: code = NotFound desc = could not find container \"be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740\": container with ID starting with be993e3084f193c0e568590d7526a06cbd1f8114849770b09f2d6889edcca740 not found: ID does not exist" May 31 17:35:30.316625 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.316598 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-8lwrj"] May 31 17:35:30.320296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.320272 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-8lwrj"] May 31 17:35:30.330517 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.330459 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9hvmx"] May 31 17:35:30.332097 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.332074 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9hvmx"] May 31 17:35:30.354291 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.354263 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57698486fc-xwh85"] May 31 17:35:30.359716 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:30.359686 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57698486fc-xwh85"] May 31 17:35:31.759633 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:31.759595 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25fde9b1-144a-4861-8677-5ed7c5d4a36e" path="/var/lib/kubelet/pods/25fde9b1-144a-4861-8677-5ed7c5d4a36e/volumes" May 31 17:35:31.760118 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:31.760102 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db13f95-cb9b-46af-9c43-16efcda9e88c" path="/var/lib/kubelet/pods/5db13f95-cb9b-46af-9c43-16efcda9e88c/volumes" May 31 17:35:31.760562 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:31.760539 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a39618-06fc-4243-b8b8-d931e628922b" path="/var/lib/kubelet/pods/76a39618-06fc-4243-b8b8-d931e628922b/volumes" May 31 17:35:32.433953 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.433916 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77f698b46f-ln8m8"] May 31 17:35:32.434296 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.434284 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25fde9b1-144a-4861-8677-5ed7c5d4a36e" containerName="authorino" May 31 17:35:32.434339 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.434298 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="25fde9b1-144a-4861-8677-5ed7c5d4a36e" containerName="authorino" May 31 17:35:32.434339 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.434310 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db13f95-cb9b-46af-9c43-16efcda9e88c" containerName="authorino" May 31 17:35:32.434339 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.434315 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db13f95-cb9b-46af-9c43-16efcda9e88c" containerName="authorino" May 31 17:35:32.434449 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.434384 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="25fde9b1-144a-4861-8677-5ed7c5d4a36e" containerName="authorino" May 31 17:35:32.434449 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.434396 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="5db13f95-cb9b-46af-9c43-16efcda9e88c" containerName="authorino" May 31 17:35:32.437557 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.437537 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:32.440649 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.440629 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qm5sp\"" May 31 17:35:32.440911 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.440893 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 31 17:35:32.449018 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.448992 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77f698b46f-ln8m8"] May 31 17:35:32.523164 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.523120 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv476\" (UniqueName: \"kubernetes.io/projected/a05205a4-ea10-449d-a974-c5e245fd0e84-kube-api-access-dv476\") pod \"maas-controller-77f698b46f-ln8m8\" (UID: \"a05205a4-ea10-449d-a974-c5e245fd0e84\") " pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:32.604026 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.603992 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-bc76q"] May 31 17:35:32.607332 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.607312 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:35:32.616143 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.616120 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-bc76q"] May 31 17:35:32.624519 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.624465 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dv476\" (UniqueName: \"kubernetes.io/projected/a05205a4-ea10-449d-a974-c5e245fd0e84-kube-api-access-dv476\") pod \"maas-controller-77f698b46f-ln8m8\" (UID: \"a05205a4-ea10-449d-a974-c5e245fd0e84\") " pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:32.634573 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.634552 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv476\" (UniqueName: \"kubernetes.io/projected/a05205a4-ea10-449d-a974-c5e245fd0e84-kube-api-access-dv476\") pod \"maas-controller-77f698b46f-ln8m8\" (UID: \"a05205a4-ea10-449d-a974-c5e245fd0e84\") " pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:32.726957 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.726861 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66v9f\" (UniqueName: \"kubernetes.io/projected/66e35ed5-0d7e-4a8f-b4f7-cf3db8251700-kube-api-access-66v9f\") pod \"maas-controller-b97b9d7cd-bc76q\" (UID: \"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700\") " pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:35:32.748706 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.748664 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:32.827446 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.827407 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66v9f\" (UniqueName: \"kubernetes.io/projected/66e35ed5-0d7e-4a8f-b4f7-cf3db8251700-kube-api-access-66v9f\") pod \"maas-controller-b97b9d7cd-bc76q\" (UID: \"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700\") " pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:35:32.837242 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.837167 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66v9f\" (UniqueName: \"kubernetes.io/projected/66e35ed5-0d7e-4a8f-b4f7-cf3db8251700-kube-api-access-66v9f\") pod \"maas-controller-b97b9d7cd-bc76q\" (UID: \"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700\") " pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:35:32.883612 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.883584 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77f698b46f-ln8m8"] May 31 17:35:32.885706 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:35:32.885673 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05205a4_ea10_449d_a974_c5e245fd0e84.slice/crio-fb7c7be53cf129ab2bae48815e3cd260cac45139ac78f0224f5fb15490397de2 WatchSource:0}: Error finding container fb7c7be53cf129ab2bae48815e3cd260cac45139ac78f0224f5fb15490397de2: Status 404 returned error can't find the container with id fb7c7be53cf129ab2bae48815e3cd260cac45139ac78f0224f5fb15490397de2 May 31 17:35:32.918867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:32.918826 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:35:33.054365 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:33.054330 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-bc76q"] May 31 17:35:33.056118 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:35:33.056088 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e35ed5_0d7e_4a8f_b4f7_cf3db8251700.slice/crio-f2d8302c8f9db4ae7e0fc9179b05ab7daf87e8c3b42c0f78b8efa63e8fec6f49 WatchSource:0}: Error finding container f2d8302c8f9db4ae7e0fc9179b05ab7daf87e8c3b42c0f78b8efa63e8fec6f49: Status 404 returned error can't find the container with id f2d8302c8f9db4ae7e0fc9179b05ab7daf87e8c3b42c0f78b8efa63e8fec6f49 May 31 17:35:33.307099 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:33.307009 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" event={"ID":"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700","Type":"ContainerStarted","Data":"f2d8302c8f9db4ae7e0fc9179b05ab7daf87e8c3b42c0f78b8efa63e8fec6f49"} May 31 17:35:33.308078 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:33.308057 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77f698b46f-ln8m8" event={"ID":"a05205a4-ea10-449d-a974-c5e245fd0e84","Type":"ContainerStarted","Data":"fb7c7be53cf129ab2bae48815e3cd260cac45139ac78f0224f5fb15490397de2"} May 31 17:35:36.322170 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:36.322132 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" event={"ID":"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700","Type":"ContainerStarted","Data":"823bbebf66adbab8124993f20677713510b4cf82e357d06c9e8abca51835c671"} May 31 17:35:36.322662 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:36.322227 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:35:36.323430 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:36.323406 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77f698b46f-ln8m8" event={"ID":"a05205a4-ea10-449d-a974-c5e245fd0e84","Type":"ContainerStarted","Data":"06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b"} May 31 17:35:36.323554 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:36.323520 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:36.341030 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:36.340974 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" podStartSLOduration=1.7906549 podStartE2EDuration="4.340958516s" podCreationTimestamp="2026-05-31 17:35:32 +0000 UTC" firstStartedPulling="2026-05-31 17:35:33.057402273 +0000 UTC m=+741.902029266" lastFinishedPulling="2026-05-31 17:35:35.607705875 +0000 UTC m=+744.452332882" observedRunningTime="2026-05-31 17:35:36.338798875 +0000 UTC m=+745.183425891" watchObservedRunningTime="2026-05-31 17:35:36.340958516 +0000 UTC m=+745.185585566" May 31 17:35:36.355439 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:36.355378 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-77f698b46f-ln8m8" podStartSLOduration=1.644506668 podStartE2EDuration="4.355360033s" podCreationTimestamp="2026-05-31 17:35:32 +0000 UTC" firstStartedPulling="2026-05-31 17:35:32.887066874 +0000 UTC m=+741.731693870" lastFinishedPulling="2026-05-31 17:35:35.597920242 +0000 UTC m=+744.442547235" observedRunningTime="2026-05-31 17:35:36.354604512 +0000 UTC m=+745.199231528" watchObservedRunningTime="2026-05-31 17:35:36.355360033 +0000 UTC m=+745.199987046" May 31 17:35:47.333908 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:47.333877 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:35:47.334393 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:47.333938 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:47.375616 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:47.375572 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77f698b46f-ln8m8"] May 31 17:35:47.375849 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:47.375820 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-77f698b46f-ln8m8" podUID="a05205a4-ea10-449d-a974-c5e245fd0e84" containerName="manager" containerID="cri-o://06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b" gracePeriod=30 May 31 17:35:47.634616 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:47.634592 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:47.767934 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:47.767902 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv476\" (UniqueName: \"kubernetes.io/projected/a05205a4-ea10-449d-a974-c5e245fd0e84-kube-api-access-dv476\") pod \"a05205a4-ea10-449d-a974-c5e245fd0e84\" (UID: \"a05205a4-ea10-449d-a974-c5e245fd0e84\") " May 31 17:35:47.770176 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:47.770142 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a05205a4-ea10-449d-a974-c5e245fd0e84-kube-api-access-dv476" (OuterVolumeSpecName: "kube-api-access-dv476") pod "a05205a4-ea10-449d-a974-c5e245fd0e84" (UID: "a05205a4-ea10-449d-a974-c5e245fd0e84"). InnerVolumeSpecName "kube-api-access-dv476". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:35:47.869216 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:47.869122 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv476\" (UniqueName: \"kubernetes.io/projected/a05205a4-ea10-449d-a974-c5e245fd0e84-kube-api-access-dv476\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:35:48.372936 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.372899 2569 generic.go:358] "Generic (PLEG): container finished" podID="a05205a4-ea10-449d-a974-c5e245fd0e84" containerID="06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b" exitCode=0 May 31 17:35:48.373336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.372969 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77f698b46f-ln8m8" May 31 17:35:48.373336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.372980 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77f698b46f-ln8m8" event={"ID":"a05205a4-ea10-449d-a974-c5e245fd0e84","Type":"ContainerDied","Data":"06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b"} May 31 17:35:48.373336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.373022 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77f698b46f-ln8m8" event={"ID":"a05205a4-ea10-449d-a974-c5e245fd0e84","Type":"ContainerDied","Data":"fb7c7be53cf129ab2bae48815e3cd260cac45139ac78f0224f5fb15490397de2"} May 31 17:35:48.373336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.373037 2569 scope.go:117] "RemoveContainer" containerID="06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b" May 31 17:35:48.382253 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.382094 2569 scope.go:117] "RemoveContainer" containerID="06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b" May 31 17:35:48.382387 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:35:48.382369 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b\": container with ID starting with 06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b not found: ID does not exist" containerID="06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b" May 31 17:35:48.382422 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.382395 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b"} err="failed to get container status \"06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b\": rpc error: code = NotFound desc = could not find container \"06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b\": container with ID starting with 06cf2b8c790f490916619aef738b8ad0115fea5748848f1cc9a962dd97764f6b not found: ID does not exist" May 31 17:35:48.395962 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.395933 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77f698b46f-ln8m8"] May 31 17:35:48.399897 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:48.399873 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77f698b46f-ln8m8"] May 31 17:35:49.757221 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:35:49.757143 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a05205a4-ea10-449d-a974-c5e245fd0e84" path="/var/lib/kubelet/pods/a05205a4-ea10-449d-a974-c5e245fd0e84/volumes" May 31 17:36:07.399842 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.399803 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-l46zv"] May 31 17:36:07.400312 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.400214 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05205a4-ea10-449d-a974-c5e245fd0e84" containerName="manager" May 31 17:36:07.400312 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.400225 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05205a4-ea10-449d-a974-c5e245fd0e84" containerName="manager" May 31 17:36:07.400312 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.400293 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="a05205a4-ea10-449d-a974-c5e245fd0e84" containerName="manager" May 31 17:36:07.406274 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.406253 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" May 31 17:36:07.409487 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.409457 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j7md4\"" May 31 17:36:07.409893 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.409877 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 31 17:36:07.413336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.413302 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-l46zv"] May 31 17:36:07.545921 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.545886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7thh\" (UniqueName: \"kubernetes.io/projected/cdbb81bc-2ddd-4f91-b653-304d36f3cb51-kube-api-access-s7thh\") pod \"payload-processing-58b6c8fdc7-l46zv\" (UID: \"cdbb81bc-2ddd-4f91-b653-304d36f3cb51\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" May 31 17:36:07.646633 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.646587 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7thh\" (UniqueName: \"kubernetes.io/projected/cdbb81bc-2ddd-4f91-b653-304d36f3cb51-kube-api-access-s7thh\") pod \"payload-processing-58b6c8fdc7-l46zv\" (UID: \"cdbb81bc-2ddd-4f91-b653-304d36f3cb51\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" May 31 17:36:07.661409 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.661339 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7thh\" (UniqueName: \"kubernetes.io/projected/cdbb81bc-2ddd-4f91-b653-304d36f3cb51-kube-api-access-s7thh\") pod \"payload-processing-58b6c8fdc7-l46zv\" (UID: \"cdbb81bc-2ddd-4f91-b653-304d36f3cb51\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" May 31 17:36:07.718523 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.718456 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" May 31 17:36:07.858383 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:07.858313 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-l46zv"] May 31 17:36:07.860868 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:36:07.860837 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbb81bc_2ddd_4f91_b653_304d36f3cb51.slice/crio-116fd624e296246ef624956480dc7d43517e50269949f9d96a081373028bcb63 WatchSource:0}: Error finding container 116fd624e296246ef624956480dc7d43517e50269949f9d96a081373028bcb63: Status 404 returned error can't find the container with id 116fd624e296246ef624956480dc7d43517e50269949f9d96a081373028bcb63 May 31 17:36:08.448624 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:08.448581 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" event={"ID":"cdbb81bc-2ddd-4f91-b653-304d36f3cb51","Type":"ContainerStarted","Data":"116fd624e296246ef624956480dc7d43517e50269949f9d96a081373028bcb63"} May 31 17:36:09.453993 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:09.453951 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" event={"ID":"cdbb81bc-2ddd-4f91-b653-304d36f3cb51","Type":"ContainerStarted","Data":"e00f11c552d6283dcb3fd12b40aefcbe1cdc9aff632eb57d0b10a4037dba182c"} May 31 17:36:09.454437 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:09.454043 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" May 31 17:36:09.472787 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:09.472737 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" podStartSLOduration=1.274057826 podStartE2EDuration="2.472722339s" podCreationTimestamp="2026-05-31 17:36:07 +0000 UTC" firstStartedPulling="2026-05-31 17:36:07.862625744 +0000 UTC m=+776.707252737" lastFinishedPulling="2026-05-31 17:36:09.061290256 +0000 UTC m=+777.905917250" observedRunningTime="2026-05-31 17:36:09.4712075 +0000 UTC m=+778.315834515" watchObservedRunningTime="2026-05-31 17:36:09.472722339 +0000 UTC m=+778.317349361" May 31 17:36:18.592575 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:18.592535 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:36:18.592991 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:18.592776 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" containerID="cri-o://81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff" gracePeriod=30 May 31 17:36:20.135539 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.135514 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.152284 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.152257 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wnlr\" (UniqueName: \"kubernetes.io/projected/4e070310-541b-4442-8f97-deb6229711d6-kube-api-access-6wnlr\") pod \"4e070310-541b-4442-8f97-deb6229711d6\" (UID: \"4e070310-541b-4442-8f97-deb6229711d6\") " May 31 17:36:20.154561 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.154526 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e070310-541b-4442-8f97-deb6229711d6-kube-api-access-6wnlr" (OuterVolumeSpecName: "kube-api-access-6wnlr") pod "4e070310-541b-4442-8f97-deb6229711d6" (UID: "4e070310-541b-4442-8f97-deb6229711d6"). InnerVolumeSpecName "kube-api-access-6wnlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:36:20.253965 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.253869 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wnlr\" (UniqueName: \"kubernetes.io/projected/4e070310-541b-4442-8f97-deb6229711d6-kube-api-access-6wnlr\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:36:20.460121 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.460086 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-l46zv" May 31 17:36:20.493294 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.493258 2569 generic.go:358] "Generic (PLEG): container finished" podID="4e070310-541b-4442-8f97-deb6229711d6" containerID="81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff" exitCode=143 May 31 17:36:20.493459 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.493310 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4e070310-541b-4442-8f97-deb6229711d6","Type":"ContainerDied","Data":"81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff"} May 31 17:36:20.493459 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.493343 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.493459 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.493358 2569 scope.go:117] "RemoveContainer" containerID="81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff" May 31 17:36:20.493459 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.493345 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4e070310-541b-4442-8f97-deb6229711d6","Type":"ContainerDied","Data":"956cc8e0acc346b8f606ceffd03d0c80effa1575deb5cc728e9cb261eac32685"} May 31 17:36:20.503712 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.503654 2569 scope.go:117] "RemoveContainer" containerID="81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff" May 31 17:36:20.504055 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:36:20.504007 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff\": container with ID starting with 81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff not found: ID does not exist" containerID="81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff" May 31 17:36:20.504055 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.504036 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff"} err="failed to get container status \"81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff\": rpc error: code = NotFound desc = could not find container \"81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff\": container with ID starting with 81a0446a42c98a36a6420bec30b50f433dee7e4c40c8e5e6030f283e9e0267ff not found: ID does not exist" May 31 17:36:20.519227 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.519182 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:36:20.521102 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.521081 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:36:20.541113 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.541083 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:36:20.541475 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.541463 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" May 31 17:36:20.541531 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.541477 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" May 31 17:36:20.541571 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.541561 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e070310-541b-4442-8f97-deb6229711d6" containerName="keycloak" May 31 17:36:20.549409 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.549381 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.552141 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.552103 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 31 17:36:20.552309 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.552287 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" May 31 17:36:20.552363 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.552243 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-w7bsj\"" May 31 17:36:20.552642 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.552625 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 31 17:36:20.552806 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.552784 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 31 17:36:20.553547 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.553525 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:36:20.657840 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.657790 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9fe5df51-ed69-4885-92f7-fe9686f1cee1-test-realms\") pod \"maas-keycloak-0\" (UID: \"9fe5df51-ed69-4885-92f7-fe9686f1cee1\") " pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.658008 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.657905 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw2vs\" (UniqueName: \"kubernetes.io/projected/9fe5df51-ed69-4885-92f7-fe9686f1cee1-kube-api-access-qw2vs\") pod \"maas-keycloak-0\" (UID: \"9fe5df51-ed69-4885-92f7-fe9686f1cee1\") " pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.759076 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.758977 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9fe5df51-ed69-4885-92f7-fe9686f1cee1-test-realms\") pod \"maas-keycloak-0\" (UID: \"9fe5df51-ed69-4885-92f7-fe9686f1cee1\") " pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.759076 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.759041 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2vs\" (UniqueName: \"kubernetes.io/projected/9fe5df51-ed69-4885-92f7-fe9686f1cee1-kube-api-access-qw2vs\") pod \"maas-keycloak-0\" (UID: \"9fe5df51-ed69-4885-92f7-fe9686f1cee1\") " pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.759728 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.759707 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9fe5df51-ed69-4885-92f7-fe9686f1cee1-test-realms\") pod \"maas-keycloak-0\" (UID: \"9fe5df51-ed69-4885-92f7-fe9686f1cee1\") " pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.768870 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.768840 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw2vs\" (UniqueName: \"kubernetes.io/projected/9fe5df51-ed69-4885-92f7-fe9686f1cee1-kube-api-access-qw2vs\") pod \"maas-keycloak-0\" (UID: \"9fe5df51-ed69-4885-92f7-fe9686f1cee1\") " pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.860957 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.860913 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 31 17:36:20.993673 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:20.993637 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 31 17:36:20.997151 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:36:20.997122 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe5df51_ed69_4885_92f7_fe9686f1cee1.slice/crio-46d7bcb544f083aa3b98ded1267f0b2a2d001f2e9476da9f814d9c30c556784b WatchSource:0}: Error finding container 46d7bcb544f083aa3b98ded1267f0b2a2d001f2e9476da9f814d9c30c556784b: Status 404 returned error can't find the container with id 46d7bcb544f083aa3b98ded1267f0b2a2d001f2e9476da9f814d9c30c556784b May 31 17:36:21.499430 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:21.499394 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9fe5df51-ed69-4885-92f7-fe9686f1cee1","Type":"ContainerStarted","Data":"18efbc3d3542961d55525471ae5b15eef5de3bf689daf9ab86d933b80c04adca"} May 31 17:36:21.499430 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:21.499431 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9fe5df51-ed69-4885-92f7-fe9686f1cee1","Type":"ContainerStarted","Data":"46d7bcb544f083aa3b98ded1267f0b2a2d001f2e9476da9f814d9c30c556784b"} May 31 17:36:21.519837 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:21.519777 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.222140776 podStartE2EDuration="1.519756298s" podCreationTimestamp="2026-05-31 17:36:20 +0000 UTC" firstStartedPulling="2026-05-31 17:36:20.998364042 +0000 UTC m=+789.842991034" lastFinishedPulling="2026-05-31 17:36:21.295979564 +0000 UTC m=+790.140606556" observedRunningTime="2026-05-31 17:36:21.518662761 +0000 UTC m=+790.363289777" watchObservedRunningTime="2026-05-31 17:36:21.519756298 +0000 UTC m=+790.364383316" May 31 17:36:21.759548 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:21.759509 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e070310-541b-4442-8f97-deb6229711d6" path="/var/lib/kubelet/pods/4e070310-541b-4442-8f97-deb6229711d6/volumes" May 31 17:36:21.861971 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:21.861928 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 31 17:36:21.863688 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:21.863652 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:22.861786 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:22.861734 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:23.861726 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:23.861670 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:24.861837 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:24.861774 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:25.861465 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:25.861413 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:26.874520 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:26.871926 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:27.862330 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:27.862273 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:28.861716 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:28.861665 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:29.861999 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:29.861951 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:30.861819 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:30.861764 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 31 17:36:30.862164 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:30.862119 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:31.861932 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:31.861878 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:32.861728 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:32.861680 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:33.862234 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:33.862174 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" May 31 17:36:34.974171 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:34.974125 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 31 17:36:34.996598 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:34.996544 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9fe5df51-ed69-4885-92f7-fe9686f1cee1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:36:44.981039 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:44.980998 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 31 17:36:55.686782 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.686742 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6955c9c755-6q9xk"] May 31 17:36:55.692204 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.692186 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.694971 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.694945 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" May 31 17:36:55.697410 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.697383 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6955c9c755-6q9xk"] May 31 17:36:55.714883 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.714850 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thjqp\" (UniqueName: \"kubernetes.io/projected/6285d56b-fa0b-431e-a763-999b46a97d7b-kube-api-access-thjqp\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.715038 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.714941 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6285d56b-fa0b-431e-a763-999b46a97d7b-oidc-ca\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.715038 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.714979 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6285d56b-fa0b-431e-a763-999b46a97d7b-tls-cert\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.815895 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.815855 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6285d56b-fa0b-431e-a763-999b46a97d7b-tls-cert\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.816096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.815908 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thjqp\" (UniqueName: \"kubernetes.io/projected/6285d56b-fa0b-431e-a763-999b46a97d7b-kube-api-access-thjqp\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.816096 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.816001 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6285d56b-fa0b-431e-a763-999b46a97d7b-oidc-ca\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.816640 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.816618 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6285d56b-fa0b-431e-a763-999b46a97d7b-oidc-ca\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.818659 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.818638 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6285d56b-fa0b-431e-a763-999b46a97d7b-tls-cert\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:55.828192 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:55.828163 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thjqp\" (UniqueName: \"kubernetes.io/projected/6285d56b-fa0b-431e-a763-999b46a97d7b-kube-api-access-thjqp\") pod \"authorino-6955c9c755-6q9xk\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:56.004117 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:56.004024 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:36:56.143336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:56.143308 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6955c9c755-6q9xk"] May 31 17:36:56.146413 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:36:56.146382 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6285d56b_fa0b_431e_a763_999b46a97d7b.slice/crio-fdd8655da05f0d474e19653d7cf5ee44c4abc874ed8d9a3dce447359f3ab4178 WatchSource:0}: Error finding container fdd8655da05f0d474e19653d7cf5ee44c4abc874ed8d9a3dce447359f3ab4178: Status 404 returned error can't find the container with id fdd8655da05f0d474e19653d7cf5ee44c4abc874ed8d9a3dce447359f3ab4178 May 31 17:36:56.648903 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:56.648864 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6955c9c755-6q9xk" event={"ID":"6285d56b-fa0b-431e-a763-999b46a97d7b","Type":"ContainerStarted","Data":"c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326"} May 31 17:36:56.648903 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:56.648906 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6955c9c755-6q9xk" event={"ID":"6285d56b-fa0b-431e-a763-999b46a97d7b","Type":"ContainerStarted","Data":"fdd8655da05f0d474e19653d7cf5ee44c4abc874ed8d9a3dce447359f3ab4178"} May 31 17:36:56.666358 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:56.666092 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6955c9c755-6q9xk" podStartSLOduration=1.260841028 podStartE2EDuration="1.666073279s" podCreationTimestamp="2026-05-31 17:36:55 +0000 UTC" firstStartedPulling="2026-05-31 17:36:56.148118671 +0000 UTC m=+824.992745664" lastFinishedPulling="2026-05-31 17:36:56.553350921 +0000 UTC m=+825.397977915" observedRunningTime="2026-05-31 17:36:56.665792364 +0000 UTC m=+825.510419380" watchObservedRunningTime="2026-05-31 17:36:56.666073279 +0000 UTC m=+825.510700294" May 31 17:36:56.690892 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:56.690839 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c6c997945-jnll6"] May 31 17:36:56.691389 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:56.691126 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-c6c997945-jnll6" podUID="7f054854-7b56-4f8b-a635-90aa37b49bdc" containerName="authorino" containerID="cri-o://cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02" gracePeriod=30 May 31 17:36:56.985917 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:56.985858 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:36:57.025958 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.025922 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdqxv\" (UniqueName: \"kubernetes.io/projected/7f054854-7b56-4f8b-a635-90aa37b49bdc-kube-api-access-bdqxv\") pod \"7f054854-7b56-4f8b-a635-90aa37b49bdc\" (UID: \"7f054854-7b56-4f8b-a635-90aa37b49bdc\") " May 31 17:36:57.026122 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.025979 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7f054854-7b56-4f8b-a635-90aa37b49bdc-tls-cert\") pod \"7f054854-7b56-4f8b-a635-90aa37b49bdc\" (UID: \"7f054854-7b56-4f8b-a635-90aa37b49bdc\") " May 31 17:36:57.028311 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.028274 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f054854-7b56-4f8b-a635-90aa37b49bdc-kube-api-access-bdqxv" (OuterVolumeSpecName: "kube-api-access-bdqxv") pod "7f054854-7b56-4f8b-a635-90aa37b49bdc" (UID: "7f054854-7b56-4f8b-a635-90aa37b49bdc"). InnerVolumeSpecName "kube-api-access-bdqxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:36:57.039801 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.039755 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f054854-7b56-4f8b-a635-90aa37b49bdc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7f054854-7b56-4f8b-a635-90aa37b49bdc" (UID: "7f054854-7b56-4f8b-a635-90aa37b49bdc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:36:57.126931 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.126895 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdqxv\" (UniqueName: \"kubernetes.io/projected/7f054854-7b56-4f8b-a635-90aa37b49bdc-kube-api-access-bdqxv\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:36:57.126931 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.126924 2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7f054854-7b56-4f8b-a635-90aa37b49bdc-tls-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:36:57.654030 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.653999 2569 generic.go:358] "Generic (PLEG): container finished" podID="7f054854-7b56-4f8b-a635-90aa37b49bdc" containerID="cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02" exitCode=0 May 31 17:36:57.654223 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.654048 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c6c997945-jnll6" May 31 17:36:57.654223 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.654087 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c6c997945-jnll6" event={"ID":"7f054854-7b56-4f8b-a635-90aa37b49bdc","Type":"ContainerDied","Data":"cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02"} May 31 17:36:57.654223 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.654130 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c6c997945-jnll6" event={"ID":"7f054854-7b56-4f8b-a635-90aa37b49bdc","Type":"ContainerDied","Data":"dccd6b8e06279b396e4e06f9ea5441b0ffd8ac0c7aa577c6dc53562cba18fcce"} May 31 17:36:57.654223 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.654149 2569 scope.go:117] "RemoveContainer" containerID="cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02" May 31 17:36:57.663336 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.663315 2569 scope.go:117] "RemoveContainer" containerID="cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02" May 31 17:36:57.663616 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:36:57.663595 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02\": container with ID starting with cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02 not found: ID does not exist" containerID="cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02" May 31 17:36:57.663720 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.663630 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02"} err="failed to get container status \"cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02\": rpc error: code = NotFound desc = could not find container \"cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02\": container with ID starting with cf86a6814966f0cce29954f23b89ce722de2a1618f00434b41d1c0655263ba02 not found: ID does not exist" May 31 17:36:57.679678 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.679640 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c6c997945-jnll6"] May 31 17:36:57.686382 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.686359 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c6c997945-jnll6"] May 31 17:36:57.757621 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:36:57.757590 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f054854-7b56-4f8b-a635-90aa37b49bdc" path="/var/lib/kubelet/pods/7f054854-7b56-4f8b-a635-90aa37b49bdc/volumes" May 31 17:37:00.211800 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.211760 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k"] May 31 17:37:00.212373 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.212353 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f054854-7b56-4f8b-a635-90aa37b49bdc" containerName="authorino" May 31 17:37:00.212475 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.212375 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f054854-7b56-4f8b-a635-90aa37b49bdc" containerName="authorino" May 31 17:37:00.212475 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.212466 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f054854-7b56-4f8b-a635-90aa37b49bdc" containerName="authorino" May 31 17:37:00.217318 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.217292 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.221194 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.221169 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 31 17:37:00.221329 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.221169 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-srx44\"" May 31 17:37:00.221329 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.221169 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 31 17:37:00.221329 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.221176 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 31 17:37:00.225261 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.225237 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k"] May 31 17:37:00.255867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.255824 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.256057 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.255901 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.256057 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.255928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c83a4587-cc7a-4957-98c1-80b56eac2b45-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.256057 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.255950 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.256057 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.255969 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.256057 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.255986 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvd4n\" (UniqueName: \"kubernetes.io/projected/c83a4587-cc7a-4957-98c1-80b56eac2b45-kube-api-access-nvd4n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357184 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357140 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357184 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357186 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c83a4587-cc7a-4957-98c1-80b56eac2b45-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357445 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357208 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357445 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357229 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357445 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357370 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvd4n\" (UniqueName: \"kubernetes.io/projected/c83a4587-cc7a-4957-98c1-80b56eac2b45-kube-api-access-nvd4n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357653 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357593 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357710 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357680 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357773 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357705 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.357773 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.357736 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.359859 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.359837 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c83a4587-cc7a-4957-98c1-80b56eac2b45-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.360076 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.360058 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c83a4587-cc7a-4957-98c1-80b56eac2b45-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.366140 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.366113 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvd4n\" (UniqueName: \"kubernetes.io/projected/c83a4587-cc7a-4957-98c1-80b56eac2b45-kube-api-access-nvd4n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k\" (UID: \"c83a4587-cc7a-4957-98c1-80b56eac2b45\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.529126 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.529032 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:00.672792 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:00.672768 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k"] May 31 17:37:00.675057 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:37:00.675022 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83a4587_cc7a_4957_98c1_80b56eac2b45.slice/crio-08e33634d855ff8cf55c9113fac0fda4b0d2c8098da70577301e78f6d17c0fb5 WatchSource:0}: Error finding container 08e33634d855ff8cf55c9113fac0fda4b0d2c8098da70577301e78f6d17c0fb5: Status 404 returned error can't find the container with id 08e33634d855ff8cf55c9113fac0fda4b0d2c8098da70577301e78f6d17c0fb5 May 31 17:37:01.671606 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:01.671560 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" event={"ID":"c83a4587-cc7a-4957-98c1-80b56eac2b45","Type":"ContainerStarted","Data":"08e33634d855ff8cf55c9113fac0fda4b0d2c8098da70577301e78f6d17c0fb5"} May 31 17:37:04.687759 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:04.687650 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" event={"ID":"c83a4587-cc7a-4957-98c1-80b56eac2b45","Type":"ContainerStarted","Data":"24bc600a31acb08b8dc463e5d6d73bf8315483ec5f92fbd85e1dc5c061a74785"} May 31 17:37:06.697903 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:06.697865 2569 generic.go:358] "Generic (PLEG): container finished" podID="c83a4587-cc7a-4957-98c1-80b56eac2b45" containerID="24bc600a31acb08b8dc463e5d6d73bf8315483ec5f92fbd85e1dc5c061a74785" exitCode=0 May 31 17:37:06.698289 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:06.697939 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" event={"ID":"c83a4587-cc7a-4957-98c1-80b56eac2b45","Type":"ContainerDied","Data":"24bc600a31acb08b8dc463e5d6d73bf8315483ec5f92fbd85e1dc5c061a74785"} May 31 17:37:08.707386 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:08.707355 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" event={"ID":"c83a4587-cc7a-4957-98c1-80b56eac2b45","Type":"ContainerStarted","Data":"0a75d19612e8cf7fbd7a89f35c52c8772b3eebdf9dd97beb76c04cb156cf5da8"} May 31 17:37:08.729269 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:08.729217 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" podStartSLOduration=1.561883041 podStartE2EDuration="8.729202291s" podCreationTimestamp="2026-05-31 17:37:00 +0000 UTC" firstStartedPulling="2026-05-31 17:37:00.676939512 +0000 UTC m=+829.521566504" lastFinishedPulling="2026-05-31 17:37:07.84425876 +0000 UTC m=+836.688885754" observedRunningTime="2026-05-31 17:37:08.72787247 +0000 UTC m=+837.572499484" watchObservedRunningTime="2026-05-31 17:37:08.729202291 +0000 UTC m=+837.573829373" May 31 17:37:10.530124 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:10.530076 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:10.530124 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:10.530127 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:10.543033 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:10.543008 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:10.725739 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:10.725706 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k" May 31 17:37:29.088120 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.088082 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955"] May 31 17:37:29.104151 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.104122 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955"] May 31 17:37:29.104308 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.104252 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.107339 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.107300 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 31 17:37:29.216893 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.216847 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q49rm\" (UniqueName: \"kubernetes.io/projected/fa76822b-e5d2-4ac4-824b-a703beada4fe-kube-api-access-q49rm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.217136 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.216928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.217136 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.216979 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.217136 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.217002 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.217136 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.217037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.217136 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.217061 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa76822b-e5d2-4ac4-824b-a703beada4fe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318292 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318255 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q49rm\" (UniqueName: \"kubernetes.io/projected/fa76822b-e5d2-4ac4-824b-a703beada4fe-kube-api-access-q49rm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318473 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318313 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318473 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318360 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318473 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318377 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318473 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318407 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318473 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318428 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa76822b-e5d2-4ac4-824b-a703beada4fe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318764 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318691 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318867 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318843 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.318926 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.318871 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.320738 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.320719 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa76822b-e5d2-4ac4-824b-a703beada4fe-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.321079 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.321058 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa76822b-e5d2-4ac4-824b-a703beada4fe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.326775 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.326751 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q49rm\" (UniqueName: \"kubernetes.io/projected/fa76822b-e5d2-4ac4-824b-a703beada4fe-kube-api-access-q49rm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955\" (UID: \"fa76822b-e5d2-4ac4-824b-a703beada4fe\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.416255 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.416155 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:29.557430 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.557405 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955"] May 31 17:37:29.559890 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:37:29.559862 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa76822b_e5d2_4ac4_824b_a703beada4fe.slice/crio-b6a54004424e4c21fc76e69b5119ef0aa7e8f545dd4c4e3d796e3781ed13f32f WatchSource:0}: Error finding container b6a54004424e4c21fc76e69b5119ef0aa7e8f545dd4c4e3d796e3781ed13f32f: Status 404 returned error can't find the container with id b6a54004424e4c21fc76e69b5119ef0aa7e8f545dd4c4e3d796e3781ed13f32f May 31 17:37:29.782798 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.782696 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" event={"ID":"fa76822b-e5d2-4ac4-824b-a703beada4fe","Type":"ContainerStarted","Data":"7c92d2503fad6fc7d87398d3df01731182d7bd7bc7d87a38bb74ea9730493c20"} May 31 17:37:29.782798 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:29.782742 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" event={"ID":"fa76822b-e5d2-4ac4-824b-a703beada4fe","Type":"ContainerStarted","Data":"b6a54004424e4c21fc76e69b5119ef0aa7e8f545dd4c4e3d796e3781ed13f32f"} May 31 17:37:31.791558 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:31.791520 2569 generic.go:358] "Generic (PLEG): container finished" podID="fa76822b-e5d2-4ac4-824b-a703beada4fe" containerID="7c92d2503fad6fc7d87398d3df01731182d7bd7bc7d87a38bb74ea9730493c20" exitCode=0 May 31 17:37:31.791936 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:31.791530 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" event={"ID":"fa76822b-e5d2-4ac4-824b-a703beada4fe","Type":"ContainerDied","Data":"7c92d2503fad6fc7d87398d3df01731182d7bd7bc7d87a38bb74ea9730493c20"} May 31 17:37:32.797597 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:32.797557 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" event={"ID":"fa76822b-e5d2-4ac4-824b-a703beada4fe","Type":"ContainerStarted","Data":"d7882e1cff8c8ff6624f752ca203902013bc830426fae811aa207f7d17f41a5f"} May 31 17:37:32.819324 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:32.819273 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" podStartSLOduration=3.661372127 podStartE2EDuration="3.819257023s" podCreationTimestamp="2026-05-31 17:37:29 +0000 UTC" firstStartedPulling="2026-05-31 17:37:31.792169994 +0000 UTC m=+860.636796990" lastFinishedPulling="2026-05-31 17:37:31.950054889 +0000 UTC m=+860.794681886" observedRunningTime="2026-05-31 17:37:32.817570531 +0000 UTC m=+861.662197546" watchObservedRunningTime="2026-05-31 17:37:32.819257023 +0000 UTC m=+861.663884038" May 31 17:37:39.416974 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:39.416928 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:39.416974 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:39.416981 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:39.429582 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:39.429551 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:39.832023 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:39.831995 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955" May 31 17:37:46.792675 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.792631 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf"] May 31 17:37:46.796888 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.796865 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.799483 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.799458 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 31 17:37:46.805820 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.805793 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf"] May 31 17:37:46.884599 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.884564 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4c5v\" (UniqueName: \"kubernetes.io/projected/1d25b5e9-93b1-4006-9088-842087cfebd9-kube-api-access-c4c5v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.884755 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.884637 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.884755 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.884678 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.884755 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.884700 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.884906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.884814 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d25b5e9-93b1-4006-9088-842087cfebd9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.884906 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.884895 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.986092 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986046 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d25b5e9-93b1-4006-9088-842087cfebd9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.986295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986135 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.986295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986164 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4c5v\" (UniqueName: \"kubernetes.io/projected/1d25b5e9-93b1-4006-9088-842087cfebd9-kube-api-access-c4c5v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.986295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986215 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.986295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986261 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.986295 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986282 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.986690 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986657 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.986690 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986682 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.987030 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.986735 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.988607 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.988582 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d25b5e9-93b1-4006-9088-842087cfebd9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.988838 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.988819 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d25b5e9-93b1-4006-9088-842087cfebd9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:46.995545 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:46.995516 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4c5v\" (UniqueName: \"kubernetes.io/projected/1d25b5e9-93b1-4006-9088-842087cfebd9-kube-api-access-c4c5v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf\" (UID: \"1d25b5e9-93b1-4006-9088-842087cfebd9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:47.109643 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:47.109602 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:47.249446 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:47.249418 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf"] May 31 17:37:47.251682 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:37:47.251638 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d25b5e9_93b1_4006_9088_842087cfebd9.slice/crio-a73b4b84656ea0451111d24b95058eee19e999be8d505e51eccb9649f5e1a7a0 WatchSource:0}: Error finding container a73b4b84656ea0451111d24b95058eee19e999be8d505e51eccb9649f5e1a7a0: Status 404 returned error can't find the container with id a73b4b84656ea0451111d24b95058eee19e999be8d505e51eccb9649f5e1a7a0 May 31 17:37:47.851441 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:47.851397 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" event={"ID":"1d25b5e9-93b1-4006-9088-842087cfebd9","Type":"ContainerStarted","Data":"2380031d829508f24e77225068d4d42d900ca77f9908268afa9d97161b9c333c"} May 31 17:37:47.851441 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:47.851433 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" event={"ID":"1d25b5e9-93b1-4006-9088-842087cfebd9","Type":"ContainerStarted","Data":"a73b4b84656ea0451111d24b95058eee19e999be8d505e51eccb9649f5e1a7a0"} May 31 17:37:48.857406 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:48.857312 2569 generic.go:358] "Generic (PLEG): container finished" podID="1d25b5e9-93b1-4006-9088-842087cfebd9" containerID="2380031d829508f24e77225068d4d42d900ca77f9908268afa9d97161b9c333c" exitCode=0 May 31 17:37:48.857406 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:48.857364 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" event={"ID":"1d25b5e9-93b1-4006-9088-842087cfebd9","Type":"ContainerDied","Data":"2380031d829508f24e77225068d4d42d900ca77f9908268afa9d97161b9c333c"} May 31 17:37:49.863178 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:49.863139 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" event={"ID":"1d25b5e9-93b1-4006-9088-842087cfebd9","Type":"ContainerStarted","Data":"9ec457ffa0a120d8648f3c495fd10ab2d3d54edb9dead9515e229a140252ba0b"} May 31 17:37:49.893161 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:49.893114 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" podStartSLOduration=3.7116399639999997 podStartE2EDuration="3.893100413s" podCreationTimestamp="2026-05-31 17:37:46 +0000 UTC" firstStartedPulling="2026-05-31 17:37:48.857928565 +0000 UTC m=+877.702555558" lastFinishedPulling="2026-05-31 17:37:49.039389012 +0000 UTC m=+877.884016007" observedRunningTime="2026-05-31 17:37:49.891713173 +0000 UTC m=+878.736340200" watchObservedRunningTime="2026-05-31 17:37:49.893100413 +0000 UTC m=+878.737727428" May 31 17:37:51.380649 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.380611 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn"] May 31 17:37:51.384864 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.384836 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.387299 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.387269 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 31 17:37:51.392262 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.392230 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn"] May 31 17:37:51.430614 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.430577 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.430832 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.430622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.430832 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.430650 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72jl2\" (UniqueName: \"kubernetes.io/projected/8e66a8dc-6dca-4cfa-b530-c0f633629a22-kube-api-access-72jl2\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.430832 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.430735 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.430832 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.430780 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e66a8dc-6dca-4cfa-b530-c0f633629a22-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.431070 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.430861 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.531966 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.531924 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.531966 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.531969 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.532212 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.531998 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72jl2\" (UniqueName: \"kubernetes.io/projected/8e66a8dc-6dca-4cfa-b530-c0f633629a22-kube-api-access-72jl2\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.532212 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.532036 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.532212 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.532060 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e66a8dc-6dca-4cfa-b530-c0f633629a22-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.532212 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.532113 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.532499 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.532466 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.532637 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.532538 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.532637 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.532559 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.534420 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.534400 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e66a8dc-6dca-4cfa-b530-c0f633629a22-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.534781 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.534761 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e66a8dc-6dca-4cfa-b530-c0f633629a22-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.540093 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.540069 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72jl2\" (UniqueName: \"kubernetes.io/projected/8e66a8dc-6dca-4cfa-b530-c0f633629a22-kube-api-access-72jl2\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn\" (UID: \"8e66a8dc-6dca-4cfa-b530-c0f633629a22\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.719413 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.719310 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:37:51.862894 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.862869 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn"] May 31 17:37:51.864848 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:37:51.864820 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e66a8dc_6dca_4cfa_b530_c0f633629a22.slice/crio-0557ad489710eec23043f37a1dc24c5c73246192c9026a0b791fef6faa715ee7 WatchSource:0}: Error finding container 0557ad489710eec23043f37a1dc24c5c73246192c9026a0b791fef6faa715ee7: Status 404 returned error can't find the container with id 0557ad489710eec23043f37a1dc24c5c73246192c9026a0b791fef6faa715ee7 May 31 17:37:51.870700 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:51.870675 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" event={"ID":"8e66a8dc-6dca-4cfa-b530-c0f633629a22","Type":"ContainerStarted","Data":"0557ad489710eec23043f37a1dc24c5c73246192c9026a0b791fef6faa715ee7"} May 31 17:37:52.877796 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:52.877755 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" event={"ID":"8e66a8dc-6dca-4cfa-b530-c0f633629a22","Type":"ContainerStarted","Data":"9ff5d012b4e80e6c1a2c2711be4e33a00b16c1fdad7d4982cf8ebae191d962e8"} May 31 17:37:53.882940 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:53.882903 2569 generic.go:358] "Generic (PLEG): container finished" podID="8e66a8dc-6dca-4cfa-b530-c0f633629a22" containerID="9ff5d012b4e80e6c1a2c2711be4e33a00b16c1fdad7d4982cf8ebae191d962e8" exitCode=0 May 31 17:37:53.883313 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:53.882984 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" event={"ID":"8e66a8dc-6dca-4cfa-b530-c0f633629a22","Type":"ContainerDied","Data":"9ff5d012b4e80e6c1a2c2711be4e33a00b16c1fdad7d4982cf8ebae191d962e8"} May 31 17:37:54.888543 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:54.888486 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" event={"ID":"8e66a8dc-6dca-4cfa-b530-c0f633629a22","Type":"ContainerStarted","Data":"c1f06ec4057130024005f343effd28163d1f844fa25fae49e46352033fe9cc53"} May 31 17:37:54.907670 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:54.907622 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" podStartSLOduration=3.72800949 podStartE2EDuration="3.907606955s" podCreationTimestamp="2026-05-31 17:37:51 +0000 UTC" firstStartedPulling="2026-05-31 17:37:53.883536227 +0000 UTC m=+882.728163220" lastFinishedPulling="2026-05-31 17:37:54.063133688 +0000 UTC m=+882.907760685" observedRunningTime="2026-05-31 17:37:54.905986329 +0000 UTC m=+883.750613346" watchObservedRunningTime="2026-05-31 17:37:54.907606955 +0000 UTC m=+883.752233969" May 31 17:37:57.110485 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:57.110443 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:57.110911 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:57.110541 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:57.123413 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:57.123383 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:37:57.910477 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:37:57.910446 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf" May 31 17:38:01.720012 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:38:01.719898 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:38:01.720012 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:38:01.719950 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:38:01.732546 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:38:01.732521 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:38:01.926204 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:38:01.926169 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn" May 31 17:38:11.990563 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:38:11.990530 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:38:11.992738 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:38:11.992713 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:38:11.994418 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:38:11.994393 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:38:12.002678 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:38:12.002655 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:39:16.382715 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.382680 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84c56f7f74-pmtff"] May 31 17:39:16.386664 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.386640 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.394680 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.394346 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84c56f7f74-pmtff"] May 31 17:39:16.464177 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.464130 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b42344a0-4245-440c-bbf8-9a45db77c7b1-tls-cert\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.464358 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.464189 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s66j\" (UniqueName: \"kubernetes.io/projected/b42344a0-4245-440c-bbf8-9a45db77c7b1-kube-api-access-9s66j\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.464358 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.464301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b42344a0-4245-440c-bbf8-9a45db77c7b1-oidc-ca\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.565116 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.565081 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s66j\" (UniqueName: \"kubernetes.io/projected/b42344a0-4245-440c-bbf8-9a45db77c7b1-kube-api-access-9s66j\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.565316 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.565147 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b42344a0-4245-440c-bbf8-9a45db77c7b1-oidc-ca\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.565316 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.565221 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b42344a0-4245-440c-bbf8-9a45db77c7b1-tls-cert\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.566058 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.565975 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b42344a0-4245-440c-bbf8-9a45db77c7b1-oidc-ca\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.567945 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.567916 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b42344a0-4245-440c-bbf8-9a45db77c7b1-tls-cert\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.572966 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.572941 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s66j\" (UniqueName: \"kubernetes.io/projected/b42344a0-4245-440c-bbf8-9a45db77c7b1-kube-api-access-9s66j\") pod \"authorino-84c56f7f74-pmtff\" (UID: \"b42344a0-4245-440c-bbf8-9a45db77c7b1\") " pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.698630 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.698478 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84c56f7f74-pmtff" May 31 17:39:16.835159 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.835130 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84c56f7f74-pmtff"] May 31 17:39:16.837738 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:39:16.837707 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb42344a0_4245_440c_bbf8_9a45db77c7b1.slice/crio-49181361b723581cf4ae6908a6e34b1eebe2aa4d490551a4aef8ebae58505b01 WatchSource:0}: Error finding container 49181361b723581cf4ae6908a6e34b1eebe2aa4d490551a4aef8ebae58505b01: Status 404 returned error can't find the container with id 49181361b723581cf4ae6908a6e34b1eebe2aa4d490551a4aef8ebae58505b01 May 31 17:39:16.839403 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:16.839385 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 17:39:17.203343 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:17.203305 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84c56f7f74-pmtff" event={"ID":"b42344a0-4245-440c-bbf8-9a45db77c7b1","Type":"ContainerStarted","Data":"49181361b723581cf4ae6908a6e34b1eebe2aa4d490551a4aef8ebae58505b01"} May 31 17:39:18.208675 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.208634 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84c56f7f74-pmtff" event={"ID":"b42344a0-4245-440c-bbf8-9a45db77c7b1","Type":"ContainerStarted","Data":"5d651aee0a79d27c6969022132937025af8defea16d95e3788e1b4b2590e0f2f"} May 31 17:39:18.225193 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.225133 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-84c56f7f74-pmtff" podStartSLOduration=1.844325118 podStartE2EDuration="2.225118159s" podCreationTimestamp="2026-05-31 17:39:16 +0000 UTC" firstStartedPulling="2026-05-31 17:39:16.839536125 +0000 UTC m=+965.684163122" lastFinishedPulling="2026-05-31 17:39:17.220329156 +0000 UTC m=+966.064956163" observedRunningTime="2026-05-31 17:39:18.224945114 +0000 UTC m=+967.069572134" watchObservedRunningTime="2026-05-31 17:39:18.225118159 +0000 UTC m=+967.069745174" May 31 17:39:18.254028 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.253983 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6955c9c755-6q9xk"] May 31 17:39:18.254219 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.254196 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6955c9c755-6q9xk" podUID="6285d56b-fa0b-431e-a763-999b46a97d7b" containerName="authorino" containerID="cri-o://c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326" gracePeriod=30 May 31 17:39:18.504657 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.504628 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:39:18.588873 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.588835 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thjqp\" (UniqueName: \"kubernetes.io/projected/6285d56b-fa0b-431e-a763-999b46a97d7b-kube-api-access-thjqp\") pod \"6285d56b-fa0b-431e-a763-999b46a97d7b\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " May 31 17:39:18.589061 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.588880 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6285d56b-fa0b-431e-a763-999b46a97d7b-tls-cert\") pod \"6285d56b-fa0b-431e-a763-999b46a97d7b\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " May 31 17:39:18.589061 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.588976 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6285d56b-fa0b-431e-a763-999b46a97d7b-oidc-ca\") pod \"6285d56b-fa0b-431e-a763-999b46a97d7b\" (UID: \"6285d56b-fa0b-431e-a763-999b46a97d7b\") " May 31 17:39:18.591249 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.591208 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6285d56b-fa0b-431e-a763-999b46a97d7b-kube-api-access-thjqp" (OuterVolumeSpecName: "kube-api-access-thjqp") pod "6285d56b-fa0b-431e-a763-999b46a97d7b" (UID: "6285d56b-fa0b-431e-a763-999b46a97d7b"). InnerVolumeSpecName "kube-api-access-thjqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:39:18.594251 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.594223 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6285d56b-fa0b-431e-a763-999b46a97d7b-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "6285d56b-fa0b-431e-a763-999b46a97d7b" (UID: "6285d56b-fa0b-431e-a763-999b46a97d7b"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:39:18.599806 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.599783 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6285d56b-fa0b-431e-a763-999b46a97d7b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6285d56b-fa0b-431e-a763-999b46a97d7b" (UID: "6285d56b-fa0b-431e-a763-999b46a97d7b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:39:18.690134 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.690101 2569 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6285d56b-fa0b-431e-a763-999b46a97d7b-oidc-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:39:18.690134 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.690132 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thjqp\" (UniqueName: \"kubernetes.io/projected/6285d56b-fa0b-431e-a763-999b46a97d7b-kube-api-access-thjqp\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:39:18.690134 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:18.690144 2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6285d56b-fa0b-431e-a763-999b46a97d7b-tls-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:39:19.214203 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.214164 2569 generic.go:358] "Generic (PLEG): container finished" podID="6285d56b-fa0b-431e-a763-999b46a97d7b" containerID="c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326" exitCode=0 May 31 17:39:19.214648 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.214215 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6955c9c755-6q9xk" May 31 17:39:19.214648 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.214250 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6955c9c755-6q9xk" event={"ID":"6285d56b-fa0b-431e-a763-999b46a97d7b","Type":"ContainerDied","Data":"c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326"} May 31 17:39:19.214648 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.214296 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6955c9c755-6q9xk" event={"ID":"6285d56b-fa0b-431e-a763-999b46a97d7b","Type":"ContainerDied","Data":"fdd8655da05f0d474e19653d7cf5ee44c4abc874ed8d9a3dce447359f3ab4178"} May 31 17:39:19.214648 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.214313 2569 scope.go:117] "RemoveContainer" containerID="c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326" May 31 17:39:19.223565 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.223545 2569 scope.go:117] "RemoveContainer" containerID="c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326" May 31 17:39:19.223813 ip-10-0-142-63 kubenswrapper[2569]: E0531 17:39:19.223794 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326\": container with ID starting with c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326 not found: ID does not exist" containerID="c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326" May 31 17:39:19.223861 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.223821 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326"} err="failed to get container status \"c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326\": rpc error: code = NotFound desc = could not find container \"c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326\": container with ID starting with c7bd258cf278ceab637ad5c5dbb8b5bc1acb6a999e1bd19bb6c7a577c0481326 not found: ID does not exist" May 31 17:39:19.237675 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.237640 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6955c9c755-6q9xk"] May 31 17:39:19.240395 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.240372 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6955c9c755-6q9xk"] May 31 17:39:19.763068 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:39:19.763033 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6285d56b-fa0b-431e-a763-999b46a97d7b" path="/var/lib/kubelet/pods/6285d56b-fa0b-431e-a763-999b46a97d7b/volumes" May 31 17:40:43.400478 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:43.400439 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-bc76q"] May 31 17:40:43.401025 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:43.400698 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" podUID="66e35ed5-0d7e-4a8f-b4f7-cf3db8251700" containerName="manager" containerID="cri-o://823bbebf66adbab8124993f20677713510b4cf82e357d06c9e8abca51835c671" gracePeriod=30 May 31 17:40:43.528477 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:43.528437 2569 generic.go:358] "Generic (PLEG): container finished" podID="66e35ed5-0d7e-4a8f-b4f7-cf3db8251700" containerID="823bbebf66adbab8124993f20677713510b4cf82e357d06c9e8abca51835c671" exitCode=0 May 31 17:40:43.528648 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:43.528520 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" event={"ID":"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700","Type":"ContainerDied","Data":"823bbebf66adbab8124993f20677713510b4cf82e357d06c9e8abca51835c671"} May 31 17:40:43.653888 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:43.653822 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:40:43.829358 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:43.829317 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66v9f\" (UniqueName: \"kubernetes.io/projected/66e35ed5-0d7e-4a8f-b4f7-cf3db8251700-kube-api-access-66v9f\") pod \"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700\" (UID: \"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700\") " May 31 17:40:43.831620 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:43.831587 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e35ed5-0d7e-4a8f-b4f7-cf3db8251700-kube-api-access-66v9f" (OuterVolumeSpecName: "kube-api-access-66v9f") pod "66e35ed5-0d7e-4a8f-b4f7-cf3db8251700" (UID: "66e35ed5-0d7e-4a8f-b4f7-cf3db8251700"). InnerVolumeSpecName "kube-api-access-66v9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:40:43.930312 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:43.930220 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66v9f\" (UniqueName: \"kubernetes.io/projected/66e35ed5-0d7e-4a8f-b4f7-cf3db8251700-kube-api-access-66v9f\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\"" May 31 17:40:44.533408 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:44.533380 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" May 31 17:40:44.533870 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:44.533403 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b97b9d7cd-bc76q" event={"ID":"66e35ed5-0d7e-4a8f-b4f7-cf3db8251700","Type":"ContainerDied","Data":"f2d8302c8f9db4ae7e0fc9179b05ab7daf87e8c3b42c0f78b8efa63e8fec6f49"} May 31 17:40:44.533870 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:44.533449 2569 scope.go:117] "RemoveContainer" containerID="823bbebf66adbab8124993f20677713510b4cf82e357d06c9e8abca51835c671" May 31 17:40:44.555731 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:44.555701 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-bc76q"] May 31 17:40:44.558910 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:44.558883 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-bc76q"] May 31 17:40:45.294056 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.294017 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-7ldbd"] May 31 17:40:45.294465 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.294448 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e35ed5-0d7e-4a8f-b4f7-cf3db8251700" containerName="manager" May 31 17:40:45.294465 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.294466 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e35ed5-0d7e-4a8f-b4f7-cf3db8251700" containerName="manager" May 31 17:40:45.294607 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.294475 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6285d56b-fa0b-431e-a763-999b46a97d7b" containerName="authorino" May 31 17:40:45.294607 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.294480 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6285d56b-fa0b-431e-a763-999b46a97d7b" containerName="authorino" May 31 17:40:45.294684 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.294607 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="6285d56b-fa0b-431e-a763-999b46a97d7b" containerName="authorino" May 31 17:40:45.294684 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.294621 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="66e35ed5-0d7e-4a8f-b4f7-cf3db8251700" containerName="manager" May 31 17:40:45.298715 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.298697 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" May 31 17:40:45.301799 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.301776 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 31 17:40:45.302660 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.302606 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qm5sp\"" May 31 17:40:45.304740 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.304717 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-7ldbd"] May 31 17:40:45.445209 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.445172 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw6xp\" (UniqueName: \"kubernetes.io/projected/e9f882c2-5061-43da-9223-2de122df75c4-kube-api-access-nw6xp\") pod \"maas-controller-b97b9d7cd-7ldbd\" (UID: \"e9f882c2-5061-43da-9223-2de122df75c4\") " pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" May 31 17:40:45.546043 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.545957 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nw6xp\" (UniqueName: \"kubernetes.io/projected/e9f882c2-5061-43da-9223-2de122df75c4-kube-api-access-nw6xp\") pod \"maas-controller-b97b9d7cd-7ldbd\" (UID: \"e9f882c2-5061-43da-9223-2de122df75c4\") " pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" May 31 17:40:45.555044 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.555009 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw6xp\" (UniqueName: \"kubernetes.io/projected/e9f882c2-5061-43da-9223-2de122df75c4-kube-api-access-nw6xp\") pod \"maas-controller-b97b9d7cd-7ldbd\" (UID: \"e9f882c2-5061-43da-9223-2de122df75c4\") " pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" May 31 17:40:45.610618 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.610588 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" May 31 17:40:45.757677 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.757644 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e35ed5-0d7e-4a8f-b4f7-cf3db8251700" path="/var/lib/kubelet/pods/66e35ed5-0d7e-4a8f-b4f7-cf3db8251700/volumes" May 31 17:40:45.953768 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:45.953723 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b97b9d7cd-7ldbd"] May 31 17:40:45.957361 ip-10-0-142-63 kubenswrapper[2569]: W0531 17:40:45.957333 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f882c2_5061_43da_9223_2de122df75c4.slice/crio-ea1c500196902d3d71bb3c2cc7259ae0f1f2c0b7808426beb891355be606c765 WatchSource:0}: Error finding container ea1c500196902d3d71bb3c2cc7259ae0f1f2c0b7808426beb891355be606c765: Status 404 returned error can't find the container with id ea1c500196902d3d71bb3c2cc7259ae0f1f2c0b7808426beb891355be606c765 May 31 17:40:46.542386 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:46.542338 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" event={"ID":"e9f882c2-5061-43da-9223-2de122df75c4","Type":"ContainerStarted","Data":"2ac9664b03d5a08729320c2fc4562135b021253d177dad6c06e3c92dd1d36893"} May 31 17:40:46.542386 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:46.542393 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" May 31 17:40:46.542669 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:46.542407 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" event={"ID":"e9f882c2-5061-43da-9223-2de122df75c4","Type":"ContainerStarted","Data":"ea1c500196902d3d71bb3c2cc7259ae0f1f2c0b7808426beb891355be606c765"} May 31 17:40:46.561907 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:46.561849 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" podStartSLOduration=1.092583819 podStartE2EDuration="1.561834577s" podCreationTimestamp="2026-05-31 17:40:45 +0000 UTC" firstStartedPulling="2026-05-31 17:40:45.958600058 +0000 UTC m=+1054.803227051" lastFinishedPulling="2026-05-31 17:40:46.4278508 +0000 UTC m=+1055.272477809" observedRunningTime="2026-05-31 17:40:46.560208666 +0000 UTC m=+1055.404835694" watchObservedRunningTime="2026-05-31 17:40:46.561834577 +0000 UTC m=+1055.406461591" May 31 17:40:57.551682 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:40:57.551651 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b97b9d7cd-7ldbd" May 31 17:43:12.026340 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:43:12.026308 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:43:12.030044 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:43:12.030019 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:43:12.030208 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:43:12.030122 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:43:12.033353 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:43:12.033335 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:48:12.054788 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:48:12.054757 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:48:12.057981 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:48:12.057957 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:48:12.058298 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:48:12.058280 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:48:12.061571 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:48:12.061554 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:53:12.091637 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:53:12.091609 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:53:12.095195 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:53:12.095170 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:53:12.095533 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:53:12.095515 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:53:12.099178 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:53:12.099160 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:58:12.128457 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:58:12.128425 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:58:12.131549 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:58:12.131525 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 17:58:12.132169 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:58:12.132148 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 17:58:12.135110 ip-10-0-142-63 kubenswrapper[2569]: I0531 17:58:12.135093 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 18:02:09.735125 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:09.735068 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c56f7f74-pmtff_b42344a0-4245-440c-bbf8-9a45db77c7b1/authorino/0.log" May 31 18:02:14.872849 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:14.872816 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b97b9d7cd-7ldbd_e9f882c2-5061-43da-9223-2de122df75c4/manager/0.log" May 31 18:02:15.456252 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:15.456223 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd7c7f585-xjgdd_4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5/copy-manifests/0.log" May 31 18:02:15.463834 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:15.463803 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd7c7f585-xjgdd_4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5/manager/0.log" May 31 18:02:16.799351 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:16.799319 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c56f7f74-pmtff_b42344a0-4245-440c-bbf8-9a45db77c7b1/authorino/0.log" May 31 18:02:16.922011 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:16.921975 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-njddp_ba7406d8-d6c4-4f62-bf11-f1a19a14a90b/manager/0.log" May 31 18:02:17.024724 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:17.024683 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-qh99s_fedca97f-433d-490a-a70f-004b943aa3f0/manager/0.log" May 31 18:02:18.269012 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:18.268983 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ccddbf6bf-6ggp2_0219d9a7-f752-442a-a6e4-db5c5b6d75bc/kube-auth-proxy/0.log" May 31 18:02:18.505091 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:18.505058 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-l46zv_cdbb81bc-2ddd-4f91-b653-304d36f3cb51/payload-processing/0.log" May 31 18:02:18.951989 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:18.951955 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k_c83a4587-cc7a-4957-98c1-80b56eac2b45/storage-initializer/0.log" May 31 18:02:18.959376 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:18.959340 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-t4c6k_c83a4587-cc7a-4957-98c1-80b56eac2b45/main/0.log" May 31 18:02:19.178988 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:19.178956 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955_fa76822b-e5d2-4ac4-824b-a703beada4fe/storage-initializer/0.log" May 31 18:02:19.187063 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:19.187033 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-d9955_fa76822b-e5d2-4ac4-824b-a703beada4fe/main/0.log" May 31 18:02:19.291199 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:19.291112 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf_1d25b5e9-93b1-4006-9088-842087cfebd9/storage-initializer/0.log" May 31 18:02:19.298250 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:19.298228 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f99vvdf_1d25b5e9-93b1-4006-9088-842087cfebd9/main/0.log" May 31 18:02:19.405003 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:19.404965 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn_8e66a8dc-6dca-4cfa-b530-c0f633629a22/storage-initializer/0.log" May 31 18:02:19.412143 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:19.412120 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-hzwxn_8e66a8dc-6dca-4cfa-b530-c0f633629a22/main/0.log" May 31 18:02:26.936666 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:26.936629 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rmgk9_748902ec-c9e7-44d5-8eba-e428e8c8d38c/global-pull-secret-syncer/0.log" May 31 18:02:27.042520 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:27.042472 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lbz6c_d4b2de9f-9753-4052-bc53-0c01558ba7b0/konnectivity-agent/0.log" May 31 18:02:27.088912 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:27.088875 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-63.ec2.internal_0306ae9d24fceb26999b9d7538d5c419/haproxy/0.log" May 31 18:02:31.599315 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:31.599277 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c56f7f74-pmtff_b42344a0-4245-440c-bbf8-9a45db77c7b1/authorino/0.log" May 31 18:02:31.628541 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:31.628477 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-njddp_ba7406d8-d6c4-4f62-bf11-f1a19a14a90b/manager/0.log" May 31 18:02:31.649359 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:31.649329 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-qh99s_fedca97f-433d-490a-a70f-004b943aa3f0/manager/0.log" May 31 18:02:33.089743 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.089717 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e2a0d43-279e-4ccb-bdad-294c35166037/alertmanager/0.log" May 31 18:02:33.113641 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.113607 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e2a0d43-279e-4ccb-bdad-294c35166037/config-reloader/0.log" May 31 18:02:33.132595 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.132539 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e2a0d43-279e-4ccb-bdad-294c35166037/kube-rbac-proxy-web/0.log" May 31 18:02:33.161407 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.161376 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e2a0d43-279e-4ccb-bdad-294c35166037/kube-rbac-proxy/0.log" May 31 18:02:33.189215 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.189168 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e2a0d43-279e-4ccb-bdad-294c35166037/kube-rbac-proxy-metric/0.log" May 31 18:02:33.213740 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.213699 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e2a0d43-279e-4ccb-bdad-294c35166037/prom-label-proxy/0.log" May 31 18:02:33.236056 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.236026 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e2a0d43-279e-4ccb-bdad-294c35166037/init-config-reloader/0.log" May 31 18:02:33.312476 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.312443 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-lvp7k_9da71949-3517-4d8b-be96-9b0f0432b2c2/kube-state-metrics/0.log" May 31 18:02:33.330157 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.330119 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-lvp7k_9da71949-3517-4d8b-be96-9b0f0432b2c2/kube-rbac-proxy-main/0.log" May 31 18:02:33.351193 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.351163 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-lvp7k_9da71949-3517-4d8b-be96-9b0f0432b2c2/kube-rbac-proxy-self/0.log" May 31 18:02:33.556190 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.556167 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bcrc_ba157311-a142-46e2-aae3-a2b5b85262fd/node-exporter/0.log" May 31 18:02:33.582626 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.582537 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bcrc_ba157311-a142-46e2-aae3-a2b5b85262fd/kube-rbac-proxy/0.log" May 31 18:02:33.608397 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.608374 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bcrc_ba157311-a142-46e2-aae3-a2b5b85262fd/init-textfile/0.log" May 31 18:02:33.815138 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.815109 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ae06d9a-803a-479b-933a-b08125f26eb9/prometheus/0.log" May 31 18:02:33.836217 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.836130 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ae06d9a-803a-479b-933a-b08125f26eb9/config-reloader/0.log" May 31 18:02:33.856903 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.856872 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ae06d9a-803a-479b-933a-b08125f26eb9/thanos-sidecar/0.log" May 31 18:02:33.878151 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.878125 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ae06d9a-803a-479b-933a-b08125f26eb9/kube-rbac-proxy-web/0.log" May 31 18:02:33.899002 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.898978 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ae06d9a-803a-479b-933a-b08125f26eb9/kube-rbac-proxy/0.log" May 31 18:02:33.921608 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.921572 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ae06d9a-803a-479b-933a-b08125f26eb9/kube-rbac-proxy-thanos/0.log" May 31 18:02:33.943159 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.943130 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ae06d9a-803a-479b-933a-b08125f26eb9/init-config-reloader/0.log" May 31 18:02:33.975191 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.975158 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-nxz9p_e316220d-b9a0-413a-87a5-436a55445313/prometheus-operator/0.log" May 31 18:02:33.993417 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:33.993383 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-nxz9p_e316220d-b9a0-413a-87a5-436a55445313/kube-rbac-proxy/0.log" May 31 18:02:34.020589 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:34.020565 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-jfclz_95b7d8da-839a-4553-beac-e80198e2eb17/prometheus-operator-admission-webhook/0.log" May 31 18:02:35.947288 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:35.947256 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/2.log" May 31 18:02:35.958485 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:35.958454 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-qkn6w_995ded47-c9c0-4571-9f75-9879ed966dc0/console-operator/3.log" May 31 18:02:37.015120 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.015092 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-vkjfg_cdecb433-ade7-41c2-ab3f-84cbf8d8e023/volume-data-source-validator/0.log" May 31 18:02:37.345684 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.345651 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt"] May 31 18:02:37.349817 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.349793 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.352626 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.352599 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwpvt\"/\"default-dockercfg-lct5b\"" May 31 18:02:37.352626 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.352616 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwpvt\"/\"kube-root-ca.crt\"" May 31 18:02:37.353421 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.353401 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwpvt\"/\"openshift-service-ca.crt\"" May 31 18:02:37.358625 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.358599 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt"] May 31 18:02:37.393755 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.393716 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-lib-modules\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.393933 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.393771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-podres\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.393933 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.393841 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-sys\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.393933 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.393890 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-proc\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.393933 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.393918 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtqbk\" (UniqueName: \"kubernetes.io/projected/2d287fd3-a9ef-4063-8f01-3d1b77b00208-kube-api-access-xtqbk\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.494886 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.494840 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-lib-modules\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.495090 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.494909 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-podres\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.495090 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.494949 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-sys\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.495090 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.494991 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-proc\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.495090 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.495022 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-lib-modules\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.495090 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.495025 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtqbk\" (UniqueName: \"kubernetes.io/projected/2d287fd3-a9ef-4063-8f01-3d1b77b00208-kube-api-access-xtqbk\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.495090 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.495058 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-podres\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.495382 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.495101 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-sys\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.495382 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.495108 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d287fd3-a9ef-4063-8f01-3d1b77b00208-proc\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.501957 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.501931 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtqbk\" (UniqueName: \"kubernetes.io/projected/2d287fd3-a9ef-4063-8f01-3d1b77b00208-kube-api-access-xtqbk\") pod \"perf-node-gather-daemonset-hzvbt\" (UID: \"2d287fd3-a9ef-4063-8f01-3d1b77b00208\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.661003 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.660905 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:37.804888 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.804865 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt"] May 31 18:02:37.807267 ip-10-0-142-63 kubenswrapper[2569]: W0531 18:02:37.807235 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d287fd3_a9ef_4063_8f01_3d1b77b00208.slice/crio-54c55c53657836b188d5dce8b24e5de89328e685765cb6ebc28565d8538b4421 WatchSource:0}: Error finding container 54c55c53657836b188d5dce8b24e5de89328e685765cb6ebc28565d8538b4421: Status 404 returned error can't find the container with id 54c55c53657836b188d5dce8b24e5de89328e685765cb6ebc28565d8538b4421 May 31 18:02:37.808851 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.808826 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 18:02:37.981255 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.981175 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zmkvc_864ff596-a523-4c11-a9bf-f0f15940074f/dns/0.log" May 31 18:02:37.999901 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:37.999861 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zmkvc_864ff596-a523-4c11-a9bf-f0f15940074f/kube-rbac-proxy/0.log" May 31 18:02:38.020237 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:38.020207 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-27xb9_3bc6e587-62f0-4943-ad56-66ac1707325e/dns-node-resolver/0.log" May 31 18:02:38.423956 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:38.423920 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" event={"ID":"2d287fd3-a9ef-4063-8f01-3d1b77b00208","Type":"ContainerStarted","Data":"e769abd87c9f2460afbf8bbdc20c5fc948f3868166dbc3b095b235ae1e77c8ff"} May 31 18:02:38.423956 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:38.423957 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" event={"ID":"2d287fd3-a9ef-4063-8f01-3d1b77b00208","Type":"ContainerStarted","Data":"54c55c53657836b188d5dce8b24e5de89328e685765cb6ebc28565d8538b4421"} May 31 18:02:38.424209 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:38.424191 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:38.439884 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:38.439836 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" podStartSLOduration=1.439820912 podStartE2EDuration="1.439820912s" podCreationTimestamp="2026-05-31 18:02:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 18:02:38.438645916 +0000 UTC m=+2367.283272931" watchObservedRunningTime="2026-05-31 18:02:38.439820912 +0000 UTC m=+2367.284447926" May 31 18:02:38.506959 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:38.506925 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cf6765bfc-fkwxz_f31f2e11-eade-4751-8f02-720253feed81/registry/1.log" May 31 18:02:38.522975 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:38.522945 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cf6765bfc-fkwxz_f31f2e11-eade-4751-8f02-720253feed81/registry/2.log" May 31 18:02:38.543449 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:38.543416 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f5jtz_3076a993-9118-4289-8f14-a8e9349d37d0/node-ca/0.log" May 31 18:02:39.506205 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:39.506167 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ccddbf6bf-6ggp2_0219d9a7-f752-442a-a6e4-db5c5b6d75bc/kube-auth-proxy/0.log" May 31 18:02:39.670303 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:39.670263 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-l46zv_cdbb81bc-2ddd-4f91-b653-304d36f3cb51/payload-processing/0.log" May 31 18:02:40.201359 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:40.201329 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9kf44_45b5735c-7b24-4029-a4a7-ef51191f5985/serve-healthcheck-canary/0.log" May 31 18:02:40.637246 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:40.637208 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-cnzn9_20c8f248-6378-4f89-b3a6-d4a34b6a9b47/insights-operator/0.log" May 31 18:02:40.640568 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:40.640546 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-cnzn9_20c8f248-6378-4f89-b3a6-d4a34b6a9b47/insights-operator/1.log" May 31 18:02:40.719104 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:40.719076 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6j8_07d5b085-594c-4352-b03c-a8a558dd2904/kube-rbac-proxy/0.log" May 31 18:02:40.737757 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:40.737732 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6j8_07d5b085-594c-4352-b03c-a8a558dd2904/exporter/0.log" May 31 18:02:40.758670 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:40.758647 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6j8_07d5b085-594c-4352-b03c-a8a558dd2904/extractor/0.log" May 31 18:02:43.080569 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:43.080537 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b97b9d7cd-7ldbd_e9f882c2-5061-43da-9223-2de122df75c4/manager/0.log" May 31 18:02:43.354809 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:43.354712 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd7c7f585-xjgdd_4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5/manager/0.log" May 31 18:02:43.372475 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:43.372447 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd7c7f585-xjgdd_4fb7d736-b2cf-4544-b7f0-d5bcd0b584f5/copy-manifests/0.log" May 31 18:02:44.438549 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:44.438521 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-hzvbt" May 31 18:02:44.680486 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:44.680419 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85597f657c-8gs2f_7804d1a5-7603-4a06-9047-27eddc4258fa/manager/0.log" May 31 18:02:49.739900 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:49.739863 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-rfrpn_f35ff586-dd68-442e-96d8-fefaae59c84b/kube-storage-version-migrator-operator/1.log" May 31 18:02:49.741403 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:49.741371 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-rfrpn_f35ff586-dd68-442e-96d8-fefaae59c84b/kube-storage-version-migrator-operator/0.log" May 31 18:02:50.782288 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:50.782260 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6qkjl_9b8bbb19-7e74-4528-aa33-e0446ad7cef4/kube-multus/0.log" May 31 18:02:50.803193 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:50.803168 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qrjg_548ef623-526e-4b47-a497-22ecfea7a2df/kube-multus-additional-cni-plugins/0.log" May 31 18:02:50.823025 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:50.822982 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qrjg_548ef623-526e-4b47-a497-22ecfea7a2df/egress-router-binary-copy/0.log" May 31 18:02:50.845658 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:50.845630 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qrjg_548ef623-526e-4b47-a497-22ecfea7a2df/cni-plugins/0.log" May 31 18:02:50.865994 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:50.865961 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qrjg_548ef623-526e-4b47-a497-22ecfea7a2df/bond-cni-plugin/0.log" May 31 18:02:50.884463 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:50.884433 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qrjg_548ef623-526e-4b47-a497-22ecfea7a2df/routeoverride-cni/0.log" May 31 18:02:50.902753 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:50.902723 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qrjg_548ef623-526e-4b47-a497-22ecfea7a2df/whereabouts-cni-bincopy/0.log" May 31 18:02:50.922347 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:50.922321 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qrjg_548ef623-526e-4b47-a497-22ecfea7a2df/whereabouts-cni/0.log" May 31 18:02:51.311145 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:51.311102 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kfgfg_829a36da-0012-4624-8443-6808a574c032/network-metrics-daemon/0.log" May 31 18:02:51.327177 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:51.327147 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kfgfg_829a36da-0012-4624-8443-6808a574c032/kube-rbac-proxy/0.log" May 31 18:02:52.161958 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.161930 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-controller/0.log" May 31 18:02:52.178219 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.178173 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/0.log" May 31 18:02:52.199026 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.198971 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovn-acl-logging/1.log" May 31 18:02:52.223817 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.223788 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/kube-rbac-proxy-node/0.log" May 31 18:02:52.246510 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.246471 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/kube-rbac-proxy-ovn-metrics/0.log" May 31 18:02:52.265086 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.265055 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/northd/0.log" May 31 18:02:52.285300 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.285275 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/nbdb/0.log" May 31 18:02:52.308472 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.308442 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/sbdb/0.log" May 31 18:02:52.497712 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:52.497614 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6jfx_2da2484b-d8b0-4de8-a4fd-ba140b62a989/ovnkube-controller/0.log" May 31 18:02:54.110076 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:54.110048 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-5q5hq_dd8ced61-a72e-4b70-bb32-9dfb7e8b1f01/check-endpoints/0.log" May 31 18:02:54.131998 ip-10-0-142-63 kubenswrapper[2569]: I0531 18:02:54.131964 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7f4sn_03a9ae7b-b6f1-4a7b-b57d-9afa687d6f96/network-check-target-container/0.log"