May 20 17:01:13.806879 ip-10-0-136-67 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 20 17:01:13.806893 ip-10-0-136-67 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 20 17:01:13.806902 ip-10-0-136-67 systemd[1]: kubelet.service: Failed with result 'resources'. May 20 17:01:13.807301 ip-10-0-136-67 systemd[1]: Failed to start Kubernetes Kubelet. May 20 17:01:24.019219 ip-10-0-136-67 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 20 17:01:24.019259 ip-10-0-136-67 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 59b937e6731345389a2e058f10fbbac4 -- May 20 17:03:58.085191 ip-10-0-136-67 systemd[1]: Starting Kubernetes Kubelet... May 20 17:03:58.596944 ip-10-0-136-67 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 17:03:58.596944 ip-10-0-136-67 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 17:03:58.596944 ip-10-0-136-67 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 17:03:58.596944 ip-10-0-136-67 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 17:03:58.596944 ip-10-0-136-67 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 17:03:58.598965 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.598854 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 17:03:58.605084 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605063 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:58.605084 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605082 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:58.605084 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605087 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605091 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605096 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605100 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605103 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605107 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605110 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605114 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605119 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605122 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605126 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605129 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605133 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605137 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605140 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605145 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605149 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605152 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605156 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605161 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:58.605294 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605172 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605177 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605180 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605184 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605189 2563 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605193 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605197 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605201 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605205 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605210 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605214 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605218 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605222 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605226 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605231 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605235 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605240 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605244 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605248 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605253 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:58.606062 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605258 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605262 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605271 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605277 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605282 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605287 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605292 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605296 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605300 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605303 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605309 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605313 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605317 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605321 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605325 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605329 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605334 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605338 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605342 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:58.606568 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605346 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605350 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605354 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605359 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605364 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605368 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605373 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605378 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605383 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605387 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605391 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605395 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605399 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605406 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605411 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605418 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605423 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605427 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605431 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:58.607341 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605436 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605440 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605444 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605449 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605453 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.605457 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.606969 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.606981 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.606986 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.606991 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.606995 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.606999 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607004 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607008 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607012 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607017 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607021 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607026 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607030 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607034 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:58.608254 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607040 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607045 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607049 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607054 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607059 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607063 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607068 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607073 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607077 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607081 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607085 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607089 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607093 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607097 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607102 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607107 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607111 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607115 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607119 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607123 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:58.609088 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607127 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607131 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607135 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607140 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607145 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607149 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607153 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607157 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607161 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607166 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607171 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607176 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607180 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607185 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607189 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607193 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607197 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607202 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607206 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607210 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:58.609644 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607214 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607218 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607222 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607226 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607230 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607234 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607238 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607242 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607246 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607253 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607259 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607263 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607266 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607271 2563 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607275 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607279 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607283 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607288 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607292 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:58.610193 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607296 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607300 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607304 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607309 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607313 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607317 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607321 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607325 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607333 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607339 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607344 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607349 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.607353 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607463 2563 flags.go:64] FLAG: --address="0.0.0.0" May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607475 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607486 2563 flags.go:64] FLAG: --anonymous-auth="true" May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607493 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607499 2563 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607504 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607518 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607525 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 17:03:58.610664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607531 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607536 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607541 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607546 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607551 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607557 2563 flags.go:64] FLAG: --cgroup-root="" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607561 2563 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607567 2563 flags.go:64] FLAG: --client-ca-file="" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607572 2563 flags.go:64] FLAG: --cloud-config="" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607577 2563 flags.go:64] FLAG: --cloud-provider="external" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607603 2563 flags.go:64] FLAG: --cluster-dns="[]" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607612 2563 flags.go:64] FLAG: --cluster-domain="" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607617 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607623 2563 flags.go:64] FLAG: --config-dir="" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607628 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607634 2563 flags.go:64] FLAG: --container-log-max-files="5" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607640 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607645 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607651 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607656 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607661 2563 flags.go:64] FLAG: --contention-profiling="false" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607666 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607671 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607676 2563 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607682 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 17:03:58.611209 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607688 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607693 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607698 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607702 2563 flags.go:64] FLAG: --enable-load-reader="false" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607707 2563 flags.go:64] FLAG: --enable-server="true" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607712 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607719 2563 flags.go:64] FLAG: --event-burst="100" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607724 2563 flags.go:64] FLAG: --event-qps="50" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607728 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607733 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607739 2563 flags.go:64] FLAG: --eviction-hard="" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607745 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607749 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607754 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607759 2563 flags.go:64] FLAG: --eviction-soft="" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607768 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607773 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607778 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607782 2563 flags.go:64] FLAG: --experimental-mounter-path="" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607787 2563 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607791 2563 flags.go:64] FLAG: --fail-swap-on="true" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607796 2563 flags.go:64] FLAG: --feature-gates="" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607802 2563 flags.go:64] FLAG: --file-check-frequency="20s" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607806 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607812 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 17:03:58.611814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607817 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607822 2563 flags.go:64] FLAG: --healthz-port="10248" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607827 2563 flags.go:64] FLAG: --help="false" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607832 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-67.ec2.internal" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607837 2563 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607842 2563 flags.go:64] FLAG: --http-check-frequency="20s" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607848 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607854 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607860 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607883 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607888 2563 flags.go:64] FLAG: --image-service-endpoint="" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607893 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607898 2563 flags.go:64] FLAG: --kube-api-burst="100" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607903 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607908 2563 flags.go:64] FLAG: --kube-api-qps="50" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607913 2563 flags.go:64] FLAG: --kube-reserved="" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607918 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607923 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607928 2563 flags.go:64] FLAG: --kubelet-cgroups="" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607933 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607937 2563 flags.go:64] FLAG: --lock-file="" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607942 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607951 2563 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607956 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 17:03:58.612440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607965 2563 flags.go:64] FLAG: --log-json-split-stream="false" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607969 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607974 2563 flags.go:64] FLAG: --log-text-split-stream="false" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607980 2563 flags.go:64] FLAG: --logging-format="text" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607984 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607990 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607994 2563 flags.go:64] FLAG: --manifest-url="" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.607999 2563 flags.go:64] FLAG: --manifest-url-header="" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608007 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608012 2563 flags.go:64] FLAG: --max-open-files="1000000" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608019 2563 flags.go:64] FLAG: --max-pods="110" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608024 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608029 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608033 2563 flags.go:64] FLAG: --memory-manager-policy="None" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608038 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608044 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608049 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608054 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608066 2563 flags.go:64] FLAG: --node-status-max-images="50" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608071 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608076 2563 flags.go:64] FLAG: --oom-score-adj="-999" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608081 2563 flags.go:64] FLAG: --pod-cidr="" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608085 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 17:03:58.613038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608094 2563 flags.go:64] FLAG: --pod-manifest-path="" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608099 2563 flags.go:64] FLAG: --pod-max-pids="-1" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608104 2563 flags.go:64] FLAG: --pods-per-core="0" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608109 2563 flags.go:64] FLAG: --port="10250" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608114 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608119 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024b7b897136b8f00" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608124 2563 flags.go:64] FLAG: --qos-reserved="" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608130 2563 flags.go:64] FLAG: --read-only-port="10255" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608136 2563 flags.go:64] FLAG: --register-node="true" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608141 2563 flags.go:64] FLAG: --register-schedulable="true" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608146 2563 flags.go:64] FLAG: --register-with-taints="" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608152 2563 flags.go:64] FLAG: --registry-burst="10" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608157 2563 flags.go:64] FLAG: --registry-qps="5" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608162 2563 flags.go:64] FLAG: --reserved-cpus="" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608166 2563 flags.go:64] FLAG: --reserved-memory="" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608172 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608176 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608181 2563 flags.go:64] FLAG: --rotate-certificates="false" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608186 2563 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608191 2563 flags.go:64] FLAG: --runonce="false" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608195 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608200 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608205 2563 flags.go:64] FLAG: --seccomp-default="false" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608210 2563 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608214 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608221 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 17:03:58.613589 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608226 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608231 2563 flags.go:64] FLAG: --storage-driver-password="root" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608236 2563 flags.go:64] FLAG: --storage-driver-secure="false" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608241 2563 flags.go:64] FLAG: --storage-driver-table="stats" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608245 2563 flags.go:64] FLAG: --storage-driver-user="root" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608250 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608254 2563 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608259 2563 flags.go:64] FLAG: --system-cgroups="" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608263 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608272 2563 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608277 2563 flags.go:64] FLAG: --tls-cert-file="" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608281 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608289 2563 flags.go:64] FLAG: --tls-min-version="" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608295 2563 flags.go:64] FLAG: --tls-private-key-file="" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608300 2563 flags.go:64] FLAG: --topology-manager-policy="none" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608305 2563 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608310 2563 flags.go:64] FLAG: --topology-manager-scope="container" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608315 2563 flags.go:64] FLAG: --v="2" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608321 2563 flags.go:64] FLAG: --version="false" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608328 2563 flags.go:64] FLAG: --vmodule="" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608336 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608341 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608498 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608505 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:58.614262 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608510 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608515 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608519 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608525 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608531 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608535 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608540 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608545 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608550 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608555 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608560 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608564 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608568 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608572 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608576 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608580 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608584 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608587 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608592 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:58.614894 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608596 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608599 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608605 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608609 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608613 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608617 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608622 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608626 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608631 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608635 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608639 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608643 2563 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608647 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608650 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608654 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608658 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608663 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608667 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608671 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:58.615381 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608675 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608679 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608683 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608688 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608692 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608695 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608700 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608704 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608708 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608712 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608716 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608720 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608725 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608729 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608732 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608738 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608742 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608746 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608750 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608754 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:58.615850 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608758 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608762 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608766 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608770 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608774 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608777 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608781 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608786 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608790 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608794 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608798 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608801 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608805 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608810 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608814 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608820 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608825 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608830 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608834 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608838 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:58.616368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608842 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608846 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608850 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608854 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608858 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.608862 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.608888 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.615917 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.615937 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616001 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616007 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616010 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616013 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616017 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616020 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:58.616881 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616023 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616026 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616028 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616031 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616034 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616037 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616039 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616042 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616045 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616048 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616052 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616057 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616060 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616063 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616065 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616068 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616071 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616074 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616076 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:58.617256 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616079 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616081 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616084 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616086 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616089 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616092 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616097 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616100 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616102 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616105 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616108 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616110 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616113 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616115 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616118 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616120 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616123 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616125 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616127 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616130 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:58.617752 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616134 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616138 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616141 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616143 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616146 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616148 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616151 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616153 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616156 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616158 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616161 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616163 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616166 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616168 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616170 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616173 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616175 2563 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616178 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616181 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616184 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:58.618271 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616187 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616189 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616192 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616194 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616197 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616199 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616202 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616204 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616206 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616209 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616211 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616214 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616216 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616219 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616221 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616223 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616226 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616228 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616231 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616233 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:58.618769 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616236 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.616241 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616344 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616349 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616352 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616355 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616358 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616360 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616363 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616366 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616369 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616372 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616376 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616378 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616381 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:58.619281 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616384 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616387 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616389 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616391 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616394 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616396 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616399 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616402 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616404 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616407 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616409 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616412 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616414 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616417 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616419 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616422 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616425 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616427 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616429 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616432 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:58.619673 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616435 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616438 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616442 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616445 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616448 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616451 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616454 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616457 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616459 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616462 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616465 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616468 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616470 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616473 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616475 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616478 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616480 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616482 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616485 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:58.620202 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616487 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616490 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616493 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616495 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616498 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616500 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616503 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616505 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616508 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616510 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616513 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616515 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616519 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616523 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616525 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616528 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616530 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616533 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616535 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616538 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:58.620708 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616540 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616542 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616545 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616547 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616550 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616553 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616555 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616557 2563 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616560 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616562 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616564 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616567 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616569 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:58.616572 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.616577 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 17:03:58.621332 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.617371 2563 server.go:962] "Client rotation is on, will bootstrap in background" May 20 17:03:58.621699 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.619430 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 17:03:58.621699 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.620426 2563 server.go:1019] "Starting client certificate rotation" May 20 17:03:58.621699 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.620540 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 17:03:58.621699 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.620575 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 17:03:58.648351 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.648325 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 17:03:58.650288 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.650260 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 17:03:58.669020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.668979 2563 log.go:25] "Validated CRI v1 runtime API" May 20 17:03:58.674337 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.674318 2563 log.go:25] "Validated CRI v1 image API" May 20 17:03:58.676468 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.676452 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 17:03:58.681284 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.681256 2563 fs.go:135] Filesystem UUIDs: map[4202262c-cbed-471f-b8e6-ef51815e76dc:/dev/nvme0n1p3 4f9c6fcc-5522-4500-bea8-8606acefe33e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 20 17:03:58.681369 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.681281 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 17:03:58.685688 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.685564 2563 manager.go:217] Machine: {Timestamp:2026-05-20 17:03:58.685038588 +0000 UTC m=+0.458061964 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101131 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dd7346a7e86ed5e64faa496dcf72f SystemUUID:ec2dd734-6a7e-86ed-5e64-faa496dcf72f BootID:59b937e6-7313-4538-9a2e-058f10fbbac4 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:67:9c:25:a4:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:67:9c:25:a4:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:ad:a7:50:e3:11 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 17:03:58.685850 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.685832 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 17:03:58.686528 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.686514 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 17:03:58.686670 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.686657 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 17:03:58.690137 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.690100 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 17:03:58.690308 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.690142 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 17:03:58.690359 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.690319 2563 topology_manager.go:138] "Creating topology manager with none policy" May 20 17:03:58.690359 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.690328 2563 container_manager_linux.go:306] "Creating device plugin manager" May 20 17:03:58.690359 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.690339 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 17:03:58.691903 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.691889 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 17:03:58.693904 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.693890 2563 state_mem.go:36] "Initialized new in-memory state store" May 20 17:03:58.694221 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.694210 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 17:03:58.696884 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.696859 2563 kubelet.go:491] "Attempting to sync node with API server" May 20 17:03:58.696930 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.696890 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 17:03:58.696930 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.696904 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 17:03:58.696930 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.696915 2563 kubelet.go:397] "Adding apiserver pod source" May 20 17:03:58.696930 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.696924 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 17:03:58.698243 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.698229 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 17:03:58.698291 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.698249 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 17:03:58.701961 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.701928 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 17:03:58.704188 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.704161 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9kqlh" May 20 17:03:58.704338 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.704325 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 17:03:58.705342 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705325 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 17:03:58.705379 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705355 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 17:03:58.705379 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705365 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 17:03:58.705435 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705377 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 17:03:58.705435 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705395 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 17:03:58.705435 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705405 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 17:03:58.705435 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705413 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 17:03:58.705435 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705427 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 17:03:58.705435 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705434 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 17:03:58.705584 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705440 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 17:03:58.705584 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705453 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 17:03:58.705640 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.705631 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 17:03:58.706474 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.706455 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 17:03:58.706506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.706476 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 17:03:58.710000 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.709973 2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 20 17:03:58.710348 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.710321 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 17:03:58.710451 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.710381 2563 server.go:1295] "Started kubelet" May 20 17:03:58.710779 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.710325 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 17:03:58.711827 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.710908 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 17:03:58.711827 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.711480 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9kqlh" May 20 17:03:58.711827 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.711782 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 17:03:58.711341 ip-10-0-136-67 systemd[1]: Started Kubernetes Kubelet. May 20 17:03:58.712121 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.711834 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 17:03:58.712121 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.711918 2563 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 17:03:58.712717 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.712526 2563 server.go:317] "Adding debug handlers to kubelet server" May 20 17:03:58.714021 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.714003 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 17:03:58.719687 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.719668 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 17:03:58.719779 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.719686 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 17:03:58.719850 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.719834 2563 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 17:03:58.719915 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.719852 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 17:03:58.720033 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.720006 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 17:03:58.720093 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.720063 2563 reconstruct.go:97] "Volume reconstruction finished" May 20 17:03:58.720093 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.720069 2563 reconciler.go:26] "Reconciler: start to sync state" May 20 17:03:58.720917 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.720896 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:58.721216 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.721197 2563 factory.go:55] Registering systemd factory May 20 17:03:58.721306 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.721221 2563 factory.go:223] Registration of the systemd container factory successfully May 20 17:03:58.722549 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.722531 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:58.723838 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.723822 2563 factory.go:153] Registering CRI-O factory May 20 17:03:58.723838 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.723841 2563 factory.go:223] Registration of the crio container factory successfully May 20 17:03:58.723997 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.723983 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 17:03:58.724048 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.724006 2563 factory.go:103] Registering Raw factory May 20 17:03:58.724048 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.724021 2563 manager.go:1196] Started watching for new ooms in manager May 20 17:03:58.724527 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.724508 2563 manager.go:319] Starting recovery of all containers May 20 17:03:58.725070 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.725046 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-67.ec2.internal\" not found" node="ip-10-0-136-67.ec2.internal" May 20 17:03:58.725795 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.725771 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 17:03:58.729130 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.729086 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 17:03:58.735072 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.735054 2563 manager.go:324] Recovery completed May 20 17:03:58.739356 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.739338 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:58.741903 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.741886 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:58.741984 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.741920 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:58.741984 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.741934 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:58.742546 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.742524 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 17:03:58.742546 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.742538 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 17:03:58.742631 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.742583 2563 state_mem.go:36] "Initialized new in-memory state store" May 20 17:03:58.744835 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.744822 2563 policy_none.go:49] "None policy: Start" May 20 17:03:58.744885 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.744839 2563 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 17:03:58.744885 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.744857 2563 state_mem.go:35] "Initializing new in-memory state store" May 20 17:03:58.793583 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.793567 2563 manager.go:341] "Starting Device Plugin manager" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.793675 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.793692 2563 server.go:85] "Starting device plugin registration server" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.793986 2563 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.793998 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.794107 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.794191 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.794201 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.794730 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 17:03:58.807562 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.794768 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:58.867815 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.867729 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 17:03:58.867815 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.867769 2563 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 17:03:58.867815 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.867788 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 17:03:58.867815 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.867797 2563 kubelet.go:2451] "Starting kubelet main sync loop" May 20 17:03:58.868075 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.867837 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 17:03:58.870137 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.870114 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:58.894280 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.894235 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:58.895246 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.895228 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:58.895337 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.895260 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:58.895337 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.895270 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:58.895337 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.895293 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-67.ec2.internal" May 20 17:03:58.903133 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.903110 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-67.ec2.internal" May 20 17:03:58.903133 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.903135 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-67.ec2.internal\": node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:58.919689 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:58.919665 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:58.968559 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.968524 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal"] May 20 17:03:58.968627 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.968612 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:58.969883 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.969855 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:58.969942 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.969908 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:58.969942 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.969919 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:58.971395 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.971383 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:58.971574 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.971559 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:03:58.971613 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.971591 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:58.972273 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.972258 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:58.972367 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.972285 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:58.972367 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.972302 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:58.972367 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.972262 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:58.972367 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.972363 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:58.972545 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.972374 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:58.973624 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.973608 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" May 20 17:03:58.973703 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.973639 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:58.974387 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.974361 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:58.974458 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.974394 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:58.974458 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:58.974407 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:59.005881 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.005832 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-67.ec2.internal\" not found" node="ip-10-0-136-67.ec2.internal" May 20 17:03:59.010189 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.010171 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-67.ec2.internal\" not found" node="ip-10-0-136-67.ec2.internal" May 20 17:03:59.019787 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.019759 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.120673 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.120570 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.121738 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.121715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6909de630039593acaa896d1a2766841-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal\" (UID: \"6909de630039593acaa896d1a2766841\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:03:59.121829 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.121754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6909de630039593acaa896d1a2766841-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal\" (UID: \"6909de630039593acaa896d1a2766841\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:03:59.121829 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.121781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79afd3d7e67ee2b12b80802096c4dad2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-67.ec2.internal\" (UID: \"79afd3d7e67ee2b12b80802096c4dad2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" May 20 17:03:59.221242 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.221197 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.222392 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.222370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6909de630039593acaa896d1a2766841-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal\" (UID: \"6909de630039593acaa896d1a2766841\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:03:59.222451 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.222395 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6909de630039593acaa896d1a2766841-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal\" (UID: \"6909de630039593acaa896d1a2766841\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:03:59.222490 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.222456 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6909de630039593acaa896d1a2766841-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal\" (UID: \"6909de630039593acaa896d1a2766841\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:03:59.222490 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.222478 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79afd3d7e67ee2b12b80802096c4dad2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-67.ec2.internal\" (UID: \"79afd3d7e67ee2b12b80802096c4dad2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" May 20 17:03:59.222549 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.222520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79afd3d7e67ee2b12b80802096c4dad2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-67.ec2.internal\" (UID: \"79afd3d7e67ee2b12b80802096c4dad2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" May 20 17:03:59.222549 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.222537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6909de630039593acaa896d1a2766841-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal\" (UID: \"6909de630039593acaa896d1a2766841\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:03:59.308533 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.308492 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:03:59.313393 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.313373 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" May 20 17:03:59.321448 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.321422 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.422005 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.421898 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.522378 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.522354 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.575784 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.575753 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:59.620631 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.620597 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 17:03:59.621543 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.620756 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 17:03:59.621543 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.620753 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 17:03:59.621543 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.620753 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 17:03:59.622777 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.622755 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.714729 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.714649 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 16:58:58 +0000 UTC" deadline="2028-02-28 02:15:03.726632928 +0000 UTC" May 20 17:03:59.714729 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.714692 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15561h11m4.011946213s" May 20 17:03:59.720246 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.720210 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 17:03:59.723374 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.723353 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.729973 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.729927 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 17:03:59.750342 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.750313 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s89qd" May 20 17:03:59.758276 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.758246 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s89qd" May 20 17:03:59.823900 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.823848 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:03:59.854612 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:59.854578 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6909de630039593acaa896d1a2766841.slice/crio-c38cd9d21ca2c4c25b17a0ac1c8a6fbdef258259d57edd6fea665adc11683d3d WatchSource:0}: Error finding container c38cd9d21ca2c4c25b17a0ac1c8a6fbdef258259d57edd6fea665adc11683d3d: Status 404 returned error can't find the container with id c38cd9d21ca2c4c25b17a0ac1c8a6fbdef258259d57edd6fea665adc11683d3d May 20 17:03:59.854798 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:03:59.854786 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79afd3d7e67ee2b12b80802096c4dad2.slice/crio-01f328736af0fd4688536fdb162d077748c885eaf2b43eab4d22a329f923b2a7 WatchSource:0}: Error finding container 01f328736af0fd4688536fdb162d077748c885eaf2b43eab4d22a329f923b2a7: Status 404 returned error can't find the container with id 01f328736af0fd4688536fdb162d077748c885eaf2b43eab4d22a329f923b2a7 May 20 17:03:59.859437 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.859421 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:03:59.870509 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.870455 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" event={"ID":"79afd3d7e67ee2b12b80802096c4dad2","Type":"ContainerStarted","Data":"01f328736af0fd4688536fdb162d077748c885eaf2b43eab4d22a329f923b2a7"} May 20 17:03:59.871300 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:03:59.871281 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" event={"ID":"6909de630039593acaa896d1a2766841","Type":"ContainerStarted","Data":"c38cd9d21ca2c4c25b17a0ac1c8a6fbdef258259d57edd6fea665adc11683d3d"} May 20 17:03:59.924738 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:03:59.924698 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:04:00.025274 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.025192 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-67.ec2.internal\" not found" May 20 17:04:00.035822 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.035801 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:04:00.120956 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.120915 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" May 20 17:04:00.131250 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.131227 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 17:04:00.132852 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.132836 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" May 20 17:04:00.143648 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.143631 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 17:04:00.697823 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.697787 2563 apiserver.go:52] "Watching apiserver" May 20 17:04:00.708906 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.708859 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 17:04:00.711939 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.711908 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-4fbsw","openshift-multus/multus-additional-cni-plugins-9wdk7","openshift-multus/network-metrics-daemon-gs5mr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d","openshift-cluster-node-tuning-operator/tuned-hqpxq","openshift-network-diagnostics/network-check-target-2knvn","openshift-network-operator/iptables-alerter-kw45v","openshift-ovn-kubernetes/ovnkube-node-fm5q4","kube-system/konnectivity-agent-vtgxs","kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal","openshift-dns/node-resolver-c4prt","openshift-image-registry/node-ca-wm24m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal"] May 20 17:04:00.713442 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.713415 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.716722 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.716020 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 17:04:00.716722 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.716033 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-svncz\"" May 20 17:04:00.716722 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.716241 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 17:04:00.717476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.717137 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.720000 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.719108 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s6czm\"" May 20 17:04:00.720000 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.719151 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:00.720000 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.719218 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:00.720000 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.719253 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 17:04:00.720000 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.719265 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 17:04:00.720000 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.719358 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 17:04:00.720818 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.720747 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.722069 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.722051 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.723089 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.723068 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 17:04:00.723302 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.723281 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bvbgl\"" May 20 17:04:00.723384 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.723309 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 17:04:00.723384 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.723376 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:00.723507 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.723460 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 17:04:00.723507 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.723482 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:00.724015 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.723998 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 17:04:00.724235 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.724219 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 17:04:00.724685 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.724534 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 17:04:00.724685 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.724551 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-87m2k\"" May 20 17:04:00.724685 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.724753 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 17:04:00.725174 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.725149 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 17:04:00.725850 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.725829 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4fbsw" May 20 17:04:00.727342 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.727322 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.727618 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.727596 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:00.728263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.728137 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lc7wt\"" May 20 17:04:00.728263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.728208 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 17:04:00.728815 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.728563 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.729340 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.729324 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 17:04:00.729633 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.729536 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 17:04:00.729633 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.729545 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wxzqs\"" May 20 17:04:00.730288 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.729934 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.730288 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.729946 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 17:04:00.730629 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.730549 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 17:04:00.730629 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.730583 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 17:04:00.730861 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.730808 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 17:04:00.731588 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.731567 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g2sbp\"" May 20 17:04:00.731693 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.731678 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 17:04:00.732013 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.731994 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 17:04:00.732227 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.732204 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 17:04:00.732629 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.732612 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sp787\"" May 20 17:04:00.732707 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.732654 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 17:04:00.733161 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.732659 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 17:04:00.733347 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.731430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:00.733420 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733408 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 17:04:00.733474 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-registration-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.733526 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-host\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.733526 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-os-release\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.733618 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zggr9\" (UniqueName: \"kubernetes.io/projected/24b4410e-71fa-4734-bc03-e9673a77bf97-kube-api-access-zggr9\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.733664 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.733710 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24b4410e-71fa-4734-bc03-e9673a77bf97-iptables-alerter-script\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.733758 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-modprobe-d\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.733828 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-socket-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.733897 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733858 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wb6jg\"" May 20 17:04:00.733951 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-device-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.734002 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.733952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjw5r\" (UniqueName: \"kubernetes.io/projected/46bacf5d-9206-4bc5-9831-a02ebc5f4077-kube-api-access-hjw5r\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.734059 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.734111 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734064 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysconfig\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.734162 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-lib-modules\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.734162 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734141 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 17:04:00.734258 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-system-cni-dir\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.734258 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-systemd\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.734342 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-tuned\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.734342 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l88sg\" (UniqueName: \"kubernetes.io/projected/a206b28c-53dd-41dd-be32-988f9cf83af5-kube-api-access-l88sg\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.734414 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkhrx\" (UniqueName: \"kubernetes.io/projected/e6b2eeb9-1b45-4073-a920-6e63f19c9384-kube-api-access-fkhrx\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:00.734414 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.734414 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqm8b\" (UniqueName: \"kubernetes.io/projected/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-kube-api-access-jqm8b\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.734576 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-var-lib-kubelet\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.734576 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-sys-fs\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.734734 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a206b28c-53dd-41dd-be32-988f9cf83af5-tmp\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.734835 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24b4410e-71fa-4734-bc03-e9673a77bf97-host-slash\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.734835 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.734835 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.735021 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.735021 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.734979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-kubernetes\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.735021 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.735011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysctl-d\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.735140 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.735041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-run\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.735140 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.735100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cnibin\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.735140 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.735128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysctl-conf\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.735274 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.735169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-sys\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.759086 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.759043 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 16:58:59 +0000 UTC" deadline="2028-02-10 01:49:11.972816924 +0000 UTC" May 20 17:04:00.759086 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.759083 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15128h45m11.213737342s" May 20 17:04:00.821422 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.821395 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 17:04:00.835550 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835497 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24b4410e-71fa-4734-bc03-e9673a77bf97-iptables-alerter-script\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.835550 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835550 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-modprobe-d\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.835792 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835582 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-socket-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.835792 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835599 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjw5r\" (UniqueName: \"kubernetes.io/projected/46bacf5d-9206-4bc5-9831-a02ebc5f4077-kube-api-access-hjw5r\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.835792 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlsm5\" (UniqueName: \"kubernetes.io/projected/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-kube-api-access-nlsm5\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.835792 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18a8a61b-9730-42d0-8f02-2187b119f7a1-agent-certs\") pod \"konnectivity-agent-vtgxs\" (UID: \"18a8a61b-9730-42d0-8f02-2187b119f7a1\") " pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:00.835792 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835752 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.835792 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835758 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-socket-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.835792 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835790 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysconfig\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836146 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.835940 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysconfig\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836146 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836048 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-modprobe-d\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836146 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-os-release\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.836282 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-cni-bin\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.836282 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836239 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24b4410e-71fa-4734-bc03-e9673a77bf97-iptables-alerter-script\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.836282 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-tmp-dir\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.836445 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836297 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-system-cni-dir\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.836445 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836319 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l88sg\" (UniqueName: \"kubernetes.io/projected/a206b28c-53dd-41dd-be32-988f9cf83af5-kube-api-access-l88sg\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836445 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-system-cni-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.836445 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836377 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-cni-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.836445 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-cnibin\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.836445 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-system-cni-dir\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.836445 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836424 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-var-lib-kubelet\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836465 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-kubelet\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836481 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-systemd-units\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-slash\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovnkube-config\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-var-lib-kubelet\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836553 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836590 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836639 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-kubernetes\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836685 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysctl-d\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-kubernetes\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836754 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-run\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.836773 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-systemd\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-node-log\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/231e130d-9265-45f0-82fd-7306d6440b07-serviceca\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836840 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cnibin\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836860 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-socket-dir-parent\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836915 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysctl-d\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-var-lib-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836956 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-run\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836962 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cnibin\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.836981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837035 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-host\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-hostroot\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-host\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovnkube-script-lib\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kszjn\" (UniqueName: \"kubernetes.io/projected/231e130d-9265-45f0-82fd-7306d6440b07-kube-api-access-kszjn\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.837394 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837211 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovn-node-metrics-cert\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837270 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837294 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-device-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-run-netns\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-ovn\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837371 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-lib-modules\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-device-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-netns\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-cni-multus\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-lib-modules\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-multus-certs\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837560 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-systemd\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837597 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-tuned\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837623 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkhrx\" (UniqueName: \"kubernetes.io/projected/e6b2eeb9-1b45-4073-a920-6e63f19c9384-kube-api-access-fkhrx\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837651 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-systemd\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837773 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.838177 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-conf-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18a8a61b-9730-42d0-8f02-2187b119f7a1-konnectivity-ca\") pod \"konnectivity-agent-vtgxs\" (UID: \"18a8a61b-9730-42d0-8f02-2187b119f7a1\") " pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-cni-bin\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837903 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-daemon-config\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837939 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.837980 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqm8b\" (UniqueName: \"kubernetes.io/projected/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-kube-api-access-jqm8b\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838000 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-sys-fs\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-env-overrides\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838113 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-sys\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-cni-binary-copy\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-kubelet\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838203 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a206b28c-53dd-41dd-be32-988f9cf83af5-tmp\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838223 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24b4410e-71fa-4734-bc03-e9673a77bf97-host-slash\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838240 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.839049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838255 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysctl-conf\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838273 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838293 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-registration-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838300 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-sys\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-run-ovn-kubernetes\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-sys-fs\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qwg4\" (UniqueName: \"kubernetes.io/projected/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-kube-api-access-2qwg4\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-k8s-cni-cncf-io\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-log-socket\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231e130d-9265-45f0-82fd-7306d6440b07-host\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838720 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-os-release\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838747 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zggr9\" (UniqueName: \"kubernetes.io/projected/24b4410e-71fa-4734-bc03-e9673a77bf97-kube-api-access-zggr9\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-etc-kubernetes\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-etc-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-cni-netd\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-os-release\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-hosts-file\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.839652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.838896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zbsd\" (UniqueName: \"kubernetes.io/projected/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-kube-api-access-4zbsd\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.840262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.839074 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-sysctl-conf\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.840262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.839104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24b4410e-71fa-4734-bc03-e9673a77bf97-host-slash\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.840262 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.839127 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:00.840262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.839170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46bacf5d-9206-4bc5-9831-a02ebc5f4077-registration-dir\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.840262 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.839215 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs podName:e6b2eeb9-1b45-4073-a920-6e63f19c9384 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:01.339168125 +0000 UTC m=+3.112191507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs") pod "network-metrics-daemon-gs5mr" (UID: "e6b2eeb9-1b45-4073-a920-6e63f19c9384") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:00.840262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.839308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.841178 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.841157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a206b28c-53dd-41dd-be32-988f9cf83af5-tmp\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.841270 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.841179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a206b28c-53dd-41dd-be32-988f9cf83af5-etc-tuned\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.849653 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.849618 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjw5r\" (UniqueName: \"kubernetes.io/projected/46bacf5d-9206-4bc5-9831-a02ebc5f4077-kube-api-access-hjw5r\") pod \"aws-ebs-csi-driver-node-g5v9d\" (UID: \"46bacf5d-9206-4bc5-9831-a02ebc5f4077\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:00.850503 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.850459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zggr9\" (UniqueName: \"kubernetes.io/projected/24b4410e-71fa-4734-bc03-e9673a77bf97-kube-api-access-zggr9\") pod \"iptables-alerter-kw45v\" (UID: \"24b4410e-71fa-4734-bc03-e9673a77bf97\") " pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:00.850640 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.850617 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l88sg\" (UniqueName: \"kubernetes.io/projected/a206b28c-53dd-41dd-be32-988f9cf83af5-kube-api-access-l88sg\") pod \"tuned-hqpxq\" (UID: \"a206b28c-53dd-41dd-be32-988f9cf83af5\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:00.851304 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.851282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqm8b\" (UniqueName: \"kubernetes.io/projected/5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8-kube-api-access-jqm8b\") pod \"multus-additional-cni-plugins-9wdk7\" (UID: \"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8\") " pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:00.851392 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.851375 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkhrx\" (UniqueName: \"kubernetes.io/projected/e6b2eeb9-1b45-4073-a920-6e63f19c9384-kube-api-access-fkhrx\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:00.939796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939757 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovn-node-metrics-cert\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.939796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939799 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-run-netns\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939828 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-ovn\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939856 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-netns\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-run-netns\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939944 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-cni-multus\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-ovn\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939990 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-netns\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.939970 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-multus-certs\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-multus-certs\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-cni-multus\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940030 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-conf-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940056 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18a8a61b-9730-42d0-8f02-2187b119f7a1-konnectivity-ca\") pod \"konnectivity-agent-vtgxs\" (UID: \"18a8a61b-9730-42d0-8f02-2187b119f7a1\") " pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940074 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-cni-bin\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940098 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-daemon-config\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940118 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940136 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-cni-bin\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940152 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-env-overrides\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940174 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-cni-binary-copy\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940198 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-kubelet\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940242 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-run-ovn-kubernetes\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940268 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qwg4\" (UniqueName: \"kubernetes.io/projected/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-kube-api-access-2qwg4\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940291 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-k8s-cni-cncf-io\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940314 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-log-socket\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940336 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231e130d-9265-45f0-82fd-7306d6440b07-host\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940363 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-etc-kubernetes\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940389 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-etc-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940416 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-cni-netd\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.940476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-conf-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940465 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-hosts-file\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-hosts-file\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940507 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zbsd\" (UniqueName: \"kubernetes.io/projected/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-kube-api-access-4zbsd\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940566 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940577 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlsm5\" (UniqueName: \"kubernetes.io/projected/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-kube-api-access-nlsm5\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18a8a61b-9730-42d0-8f02-2187b119f7a1-konnectivity-ca\") pod \"konnectivity-agent-vtgxs\" (UID: \"18a8a61b-9730-42d0-8f02-2187b119f7a1\") " pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-run-k8s-cni-cncf-io\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940732 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-daemon-config\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-etc-kubernetes\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940835 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-log-socket\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940901 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231e130d-9265-45f0-82fd-7306d6440b07-host\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-etc-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.940983 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-cni-netd\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-env-overrides\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941020 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-run-ovn-kubernetes\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-kubelet\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941108 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18a8a61b-9730-42d0-8f02-2187b119f7a1-agent-certs\") pod \"konnectivity-agent-vtgxs\" (UID: \"18a8a61b-9730-42d0-8f02-2187b119f7a1\") " pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:00.941263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941138 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-os-release\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941163 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-cni-bin\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-cni-binary-copy\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941187 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-tmp-dir\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941215 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-system-cni-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-os-release\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941238 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-cni-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-host-var-lib-cni-bin\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941264 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-cnibin\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-system-cni-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-cnibin\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941343 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-kubelet\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941401 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-systemd-units\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-kubelet\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941418 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-slash\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-cni-dir\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941435 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovnkube-config\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941460 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-systemd\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.942212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941477 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-tmp-dir\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941506 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-node-log\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941514 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-host-slash\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941480 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-node-log\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-systemd\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941462 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-systemd-units\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941552 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/231e130d-9265-45f0-82fd-7306d6440b07-serviceca\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941581 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-socket-dir-parent\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941605 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-var-lib-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941631 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941659 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-hostroot\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941684 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovnkube-script-lib\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941727 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kszjn\" (UniqueName: \"kubernetes.io/projected/231e130d-9265-45f0-82fd-7306d6440b07-kube-api-access-kszjn\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-run-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/231e130d-9265-45f0-82fd-7306d6440b07-serviceca\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941906 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-multus-socket-dir-parent\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941916 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-hostroot\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941909 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovnkube-config\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.941940 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-var-lib-openvswitch\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943989 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.942622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovnkube-script-lib\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.943989 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.942721 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-ovn-node-metrics-cert\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.944271 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.944252 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18a8a61b-9730-42d0-8f02-2187b119f7a1-agent-certs\") pod \"konnectivity-agent-vtgxs\" (UID: \"18a8a61b-9730-42d0-8f02-2187b119f7a1\") " pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:00.946114 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.946094 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:04:00.946114 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.946120 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:04:00.946236 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.946134 2563 projected.go:194] Error preparing data for projected volume kube-api-access-mpkw8 for pod openshift-network-diagnostics/network-check-target-2knvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:00.946236 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:00.946198 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8 podName:79a1e756-5525-42f1-84e6-1c066b38a115 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:01.446179231 +0000 UTC m=+3.219202613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkw8" (UniqueName: "kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8") pod "network-check-target-2knvn" (UID: "79a1e756-5525-42f1-84e6-1c066b38a115") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:00.948767 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.948709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlsm5\" (UniqueName: \"kubernetes.io/projected/94992ae1-f9df-4d7c-adcf-ab2ddb57770c-kube-api-access-nlsm5\") pod \"multus-4fbsw\" (UID: \"94992ae1-f9df-4d7c-adcf-ab2ddb57770c\") " pod="openshift-multus/multus-4fbsw" May 20 17:04:00.949135 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.949111 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qwg4\" (UniqueName: \"kubernetes.io/projected/a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe-kube-api-access-2qwg4\") pod \"ovnkube-node-fm5q4\" (UID: \"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:00.949220 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.949206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zbsd\" (UniqueName: \"kubernetes.io/projected/2ac8bbc9-e535-4830-9fc3-afa16269a6f0-kube-api-access-4zbsd\") pod \"node-resolver-c4prt\" (UID: \"2ac8bbc9-e535-4830-9fc3-afa16269a6f0\") " pod="openshift-dns/node-resolver-c4prt" May 20 17:04:00.949531 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:00.949506 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kszjn\" (UniqueName: \"kubernetes.io/projected/231e130d-9265-45f0-82fd-7306d6440b07-kube-api-access-kszjn\") pod \"node-ca-wm24m\" (UID: \"231e130d-9265-45f0-82fd-7306d6440b07\") " pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:01.025535 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.025499 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" May 20 17:04:01.042450 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.042404 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kw45v" May 20 17:04:01.051326 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.051298 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" May 20 17:04:01.055953 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.055931 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" May 20 17:04:01.063580 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.063539 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4fbsw" May 20 17:04:01.070454 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.070417 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:01.072473 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.072456 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:04:01.079490 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.079462 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:01.081567 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.081547 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:04:01.088423 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.088395 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4prt" May 20 17:04:01.095187 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.095154 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wm24m" May 20 17:04:01.345025 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.344989 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:01.345187 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:01.345141 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:01.345229 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:01.345213 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs podName:e6b2eeb9-1b45-4073-a920-6e63f19c9384 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:02.345193561 +0000 UTC m=+4.118216929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs") pod "network-metrics-daemon-gs5mr" (UID: "e6b2eeb9-1b45-4073-a920-6e63f19c9384") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:01.545959 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.545925 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:01.546119 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:01.546084 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:04:01.546119 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:01.546105 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:04:01.546119 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:01.546115 2563 projected.go:194] Error preparing data for projected volume kube-api-access-mpkw8 for pod openshift-network-diagnostics/network-check-target-2knvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:01.546238 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:01.546165 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8 podName:79a1e756-5525-42f1-84e6-1c066b38a115 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:02.546151558 +0000 UTC m=+4.319174925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkw8" (UniqueName: "kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8") pod "network-check-target-2knvn" (UID: "79a1e756-5525-42f1-84e6-1c066b38a115") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:01.569882 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:04:01.569642 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b4410e_71fa_4734_bc03_e9673a77bf97.slice/crio-ae19386ad5624a9ff768136f85b1b092bc8d280497c21945bd2344b12dcb99c8 WatchSource:0}: Error finding container ae19386ad5624a9ff768136f85b1b092bc8d280497c21945bd2344b12dcb99c8: Status 404 returned error can't find the container with id ae19386ad5624a9ff768136f85b1b092bc8d280497c21945bd2344b12dcb99c8 May 20 17:04:01.572366 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:04:01.572294 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94992ae1_f9df_4d7c_adcf_ab2ddb57770c.slice/crio-7542316c62e46dc40ddf99b4b59de3437a0c81187e1c374657fb2a69f0571596 WatchSource:0}: Error finding container 7542316c62e46dc40ddf99b4b59de3437a0c81187e1c374657fb2a69f0571596: Status 404 returned error can't find the container with id 7542316c62e46dc40ddf99b4b59de3437a0c81187e1c374657fb2a69f0571596 May 20 17:04:01.576196 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:04:01.576174 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a8a61b_9730_42d0_8f02_2187b119f7a1.slice/crio-e51dce8b014fe3d6c1460daf0adf8b0bd34b58ee3a1ef5ea6fb38e7dee752f98 WatchSource:0}: Error finding container e51dce8b014fe3d6c1460daf0adf8b0bd34b58ee3a1ef5ea6fb38e7dee752f98: Status 404 returned error can't find the container with id e51dce8b014fe3d6c1460daf0adf8b0bd34b58ee3a1ef5ea6fb38e7dee752f98 May 20 17:04:01.576796 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:04:01.576756 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda206b28c_53dd_41dd_be32_988f9cf83af5.slice/crio-71d4631457554b7c7f3e90ad34feb6079bdecd785cfbf6e1cc2cb75e058b2da4 WatchSource:0}: Error finding container 71d4631457554b7c7f3e90ad34feb6079bdecd785cfbf6e1cc2cb75e058b2da4: Status 404 returned error can't find the container with id 71d4631457554b7c7f3e90ad34feb6079bdecd785cfbf6e1cc2cb75e058b2da4 May 20 17:04:01.577826 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:04:01.577743 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d7195f_fefe_44ef_aa7f_ccce8eed9ffe.slice/crio-222ddfadaee7f25f62daccb6286262216d527a944af9deb06df0250c3b41462a WatchSource:0}: Error finding container 222ddfadaee7f25f62daccb6286262216d527a944af9deb06df0250c3b41462a: Status 404 returned error can't find the container with id 222ddfadaee7f25f62daccb6286262216d527a944af9deb06df0250c3b41462a May 20 17:04:01.578778 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:04:01.578756 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231e130d_9265_45f0_82fd_7306d6440b07.slice/crio-f1f785a87f088e7c052c06e53dedf605d08bab57d4b384cf58631baa307ee1ce WatchSource:0}: Error finding container f1f785a87f088e7c052c06e53dedf605d08bab57d4b384cf58631baa307ee1ce: Status 404 returned error can't find the container with id f1f785a87f088e7c052c06e53dedf605d08bab57d4b384cf58631baa307ee1ce May 20 17:04:01.585729 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:04:01.585635 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef3c1a9_f3c0_4adb_ae2d_d3368164b4a8.slice/crio-530343270b9a2eceb5410dbec2c6de2a4a2cdd27a4fe46d649ab360a48bbe333 WatchSource:0}: Error finding container 530343270b9a2eceb5410dbec2c6de2a4a2cdd27a4fe46d649ab360a48bbe333: Status 404 returned error can't find the container with id 530343270b9a2eceb5410dbec2c6de2a4a2cdd27a4fe46d649ab360a48bbe333 May 20 17:04:01.759547 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.759501 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 16:58:59 +0000 UTC" deadline="2028-02-26 11:36:20.732184194 +0000 UTC" May 20 17:04:01.759547 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.759541 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15522h32m18.972645195s" May 20 17:04:01.876438 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.876403 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" event={"ID":"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8","Type":"ContainerStarted","Data":"530343270b9a2eceb5410dbec2c6de2a4a2cdd27a4fe46d649ab360a48bbe333"} May 20 17:04:01.877409 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.877384 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4prt" event={"ID":"2ac8bbc9-e535-4830-9fc3-afa16269a6f0","Type":"ContainerStarted","Data":"c971a40eb81ddb593a5d0ea35329d7eddf72b384fcd2a6410ecd3301dc6279a1"} May 20 17:04:01.878464 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.878414 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"222ddfadaee7f25f62daccb6286262216d527a944af9deb06df0250c3b41462a"} May 20 17:04:01.880264 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.880239 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vtgxs" event={"ID":"18a8a61b-9730-42d0-8f02-2187b119f7a1","Type":"ContainerStarted","Data":"e51dce8b014fe3d6c1460daf0adf8b0bd34b58ee3a1ef5ea6fb38e7dee752f98"} May 20 17:04:01.881275 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.881253 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kw45v" event={"ID":"24b4410e-71fa-4734-bc03-e9673a77bf97","Type":"ContainerStarted","Data":"ae19386ad5624a9ff768136f85b1b092bc8d280497c21945bd2344b12dcb99c8"} May 20 17:04:01.885061 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.885040 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" event={"ID":"6909de630039593acaa896d1a2766841","Type":"ContainerStarted","Data":"eff4c545fdebb2f19cc1702b68208db8b6ba657743237d3108684916d49eb3e7"} May 20 17:04:01.886001 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.885982 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" event={"ID":"46bacf5d-9206-4bc5-9831-a02ebc5f4077","Type":"ContainerStarted","Data":"2f02dd7e7b0e3d36681c96150ad2c7ae1475303ef162b0e66752922ed5461ffd"} May 20 17:04:01.886960 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.886940 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wm24m" event={"ID":"231e130d-9265-45f0-82fd-7306d6440b07","Type":"ContainerStarted","Data":"f1f785a87f088e7c052c06e53dedf605d08bab57d4b384cf58631baa307ee1ce"} May 20 17:04:01.887902 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.887851 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4fbsw" event={"ID":"94992ae1-f9df-4d7c-adcf-ab2ddb57770c","Type":"ContainerStarted","Data":"7542316c62e46dc40ddf99b4b59de3437a0c81187e1c374657fb2a69f0571596"} May 20 17:04:01.890482 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.890457 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" event={"ID":"79afd3d7e67ee2b12b80802096c4dad2","Type":"ContainerStarted","Data":"ab04856fce3b527daa86a281bc655a738fb9850199be2d1deb540dcc39e0d0d2"} May 20 17:04:01.891302 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.891284 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" event={"ID":"a206b28c-53dd-41dd-be32-988f9cf83af5","Type":"ContainerStarted","Data":"71d4631457554b7c7f3e90ad34feb6079bdecd785cfbf6e1cc2cb75e058b2da4"} May 20 17:04:01.911113 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:01.911074 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-67.ec2.internal" podStartSLOduration=1.911060669 podStartE2EDuration="1.911060669s" podCreationTimestamp="2026-05-20 17:04:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:04:01.910917608 +0000 UTC m=+3.683940993" watchObservedRunningTime="2026-05-20 17:04:01.911060669 +0000 UTC m=+3.684084054" May 20 17:04:02.095629 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:02.095081 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:04:02.351830 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:02.351790 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:02.352018 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:02.351996 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:02.352098 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:02.352061 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs podName:e6b2eeb9-1b45-4073-a920-6e63f19c9384 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:04.352041507 +0000 UTC m=+6.125064876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs") pod "network-metrics-daemon-gs5mr" (UID: "e6b2eeb9-1b45-4073-a920-6e63f19c9384") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:02.553498 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:02.553431 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:02.553688 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:02.553641 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:04:02.553688 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:02.553663 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:04:02.553688 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:02.553675 2563 projected.go:194] Error preparing data for projected volume kube-api-access-mpkw8 for pod openshift-network-diagnostics/network-check-target-2knvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:02.553834 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:02.553735 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8 podName:79a1e756-5525-42f1-84e6-1c066b38a115 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:04.55371607 +0000 UTC m=+6.326739449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkw8" (UniqueName: "kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8") pod "network-check-target-2knvn" (UID: "79a1e756-5525-42f1-84e6-1c066b38a115") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:02.870923 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:02.870890 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:02.871431 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:02.871030 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:02.871499 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:02.871450 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:02.871554 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:02.871536 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:02.899489 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:02.899449 2563 generic.go:358] "Generic (PLEG): container finished" podID="6909de630039593acaa896d1a2766841" containerID="eff4c545fdebb2f19cc1702b68208db8b6ba657743237d3108684916d49eb3e7" exitCode=0 May 20 17:04:02.900375 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:02.900343 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" event={"ID":"6909de630039593acaa896d1a2766841","Type":"ContainerDied","Data":"eff4c545fdebb2f19cc1702b68208db8b6ba657743237d3108684916d49eb3e7"} May 20 17:04:03.931284 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:03.931239 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" event={"ID":"6909de630039593acaa896d1a2766841","Type":"ContainerStarted","Data":"247ebc219df83074d161096218f59dba42925f0c252ab1a6ec6f48ab22a914f9"} May 20 17:04:04.371134 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:04.371093 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:04.371447 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:04.371393 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:04.371541 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:04.371463 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs podName:e6b2eeb9-1b45-4073-a920-6e63f19c9384 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:08.371442578 +0000 UTC m=+10.144465955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs") pod "network-metrics-daemon-gs5mr" (UID: "e6b2eeb9-1b45-4073-a920-6e63f19c9384") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:04.573144 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:04.573105 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:04.573339 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:04.573322 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:04:04.573405 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:04.573346 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:04:04.573405 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:04.573360 2563 projected.go:194] Error preparing data for projected volume kube-api-access-mpkw8 for pod openshift-network-diagnostics/network-check-target-2knvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:04.573511 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:04.573424 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8 podName:79a1e756-5525-42f1-84e6-1c066b38a115 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:08.573406176 +0000 UTC m=+10.346429542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkw8" (UniqueName: "kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8") pod "network-check-target-2knvn" (UID: "79a1e756-5525-42f1-84e6-1c066b38a115") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:04.872798 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:04.872746 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:04.873007 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:04.872911 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:04.873274 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:04.873254 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:04.873370 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:04.873351 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:06.868098 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:06.868061 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:06.868551 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:06.868071 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:06.868551 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:06.868196 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:06.868551 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:06.868295 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:08.411403 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:08.411341 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:08.411950 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:08.411610 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:08.412024 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:08.412010 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs podName:e6b2eeb9-1b45-4073-a920-6e63f19c9384 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:16.411679557 +0000 UTC m=+18.184702927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs") pod "network-metrics-daemon-gs5mr" (UID: "e6b2eeb9-1b45-4073-a920-6e63f19c9384") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:08.613514 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:08.613468 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:08.613696 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:08.613677 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:04:08.613747 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:08.613706 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:04:08.613747 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:08.613722 2563 projected.go:194] Error preparing data for projected volume kube-api-access-mpkw8 for pod openshift-network-diagnostics/network-check-target-2knvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:08.613834 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:08.613793 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8 podName:79a1e756-5525-42f1-84e6-1c066b38a115 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:16.613774341 +0000 UTC m=+18.386797709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkw8" (UniqueName: "kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8") pod "network-check-target-2knvn" (UID: "79a1e756-5525-42f1-84e6-1c066b38a115") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:08.870760 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:08.869782 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:08.870760 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:08.869917 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:08.870760 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:08.869960 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:08.870760 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:08.870066 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:10.870495 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:10.869997 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:10.870495 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:10.869997 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:10.870495 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:10.870144 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:10.870495 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:10.870203 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:12.868228 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:12.868192 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:12.868653 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:12.868303 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:12.868653 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:12.868362 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:12.868653 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:12.868459 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:14.868298 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:14.868264 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:14.868686 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:14.868409 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:14.868686 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:14.868467 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:14.868686 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:14.868592 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:16.470801 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:16.470760 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:16.471270 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:16.470900 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:16.471270 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:16.470963 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs podName:e6b2eeb9-1b45-4073-a920-6e63f19c9384 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:32.47094385 +0000 UTC m=+34.243967212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs") pod "network-metrics-daemon-gs5mr" (UID: "e6b2eeb9-1b45-4073-a920-6e63f19c9384") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:16.672199 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:16.672151 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:16.672391 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:16.672338 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:04:16.672391 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:16.672362 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:04:16.672391 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:16.672377 2563 projected.go:194] Error preparing data for projected volume kube-api-access-mpkw8 for pod openshift-network-diagnostics/network-check-target-2knvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:16.672530 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:16.672443 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8 podName:79a1e756-5525-42f1-84e6-1c066b38a115 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:32.67242531 +0000 UTC m=+34.445448677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkw8" (UniqueName: "kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8") pod "network-check-target-2knvn" (UID: "79a1e756-5525-42f1-84e6-1c066b38a115") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:16.869903 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:16.868063 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:16.869903 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:16.868077 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:16.869903 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:16.868199 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:16.869903 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:16.868294 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:18.869407 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:18.868933 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:18.869407 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:18.868981 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:18.869407 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:18.869056 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:18.869407 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:18.869185 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:20.868982 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.868651 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:20.869541 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.868726 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:20.869541 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:20.869117 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:20.869541 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:20.869202 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:20.966034 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.965999 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"901115f3302710ba554b38c353cd5afccd7021e78908908f8593ea5a0167b3e7"} May 20 17:04:20.966183 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.966043 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"a421e5151a8539066b0bc3594d8346f39d8577b70b46fac774c7dc55060f497c"} May 20 17:04:20.966183 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.966057 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"abbf9bc07303dfae6180dd6515084151371006c4650713b349a29c1f94dbc52c"} May 20 17:04:20.966183 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.966069 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"d8be36dfe599eb61b16941467b3845f48c0a0de7434dd80b8f99cb41df43fd9d"} May 20 17:04:20.966183 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.966081 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"4a871120a761b62c9eafc927133b0b991c8a2d199a79f82dfb77e09535fa755d"} May 20 17:04:20.966183 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.966094 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"ab8901ae2d50b31bc487eedc02cf5616ed1700b27c26f972adc318375ab5a9d1"} May 20 17:04:20.967275 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.967242 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vtgxs" event={"ID":"18a8a61b-9730-42d0-8f02-2187b119f7a1","Type":"ContainerStarted","Data":"095e811097bfd35eeb56c7677fbfa9426a63a26db57efa684531252eb67de2df"} May 20 17:04:20.968476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.968442 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" event={"ID":"46bacf5d-9206-4bc5-9831-a02ebc5f4077","Type":"ContainerStarted","Data":"a79f21860eefcfc353f48549fe3f8984781b840637dbb1c837682633e8f727b4"} May 20 17:04:20.969535 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.969512 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wm24m" event={"ID":"231e130d-9265-45f0-82fd-7306d6440b07","Type":"ContainerStarted","Data":"9357fb1da5ee6fa1f16de934c9180ddaa79694d8e8bf26f2e523786bd88ab633"} May 20 17:04:20.970671 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.970642 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4fbsw" event={"ID":"94992ae1-f9df-4d7c-adcf-ab2ddb57770c","Type":"ContainerStarted","Data":"fdc93214671225911f7ae03e085847f3f4144e3227e49d7be7c2fdc7640d3f17"} May 20 17:04:20.971835 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.971812 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" event={"ID":"a206b28c-53dd-41dd-be32-988f9cf83af5","Type":"ContainerStarted","Data":"ab08c3d34b28663f24b8572afdf89f376d6c6024ed22828e395a8779e1071ca9"} May 20 17:04:20.973085 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.973063 2563 generic.go:358] "Generic (PLEG): container finished" podID="5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8" containerID="dfeab678c02938f5881add91685b3edb53e109444d9c0b8c704e47f3d696f82c" exitCode=0 May 20 17:04:20.973159 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.973131 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" event={"ID":"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8","Type":"ContainerDied","Data":"dfeab678c02938f5881add91685b3edb53e109444d9c0b8c704e47f3d696f82c"} May 20 17:04:20.974357 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.974307 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4prt" event={"ID":"2ac8bbc9-e535-4830-9fc3-afa16269a6f0","Type":"ContainerStarted","Data":"da1d67cd8fc5c52a2e9173904f33273bbcaa4a597c3606a471eb45948743b624"} May 20 17:04:20.982137 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.982095 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vtgxs" podStartSLOduration=3.307689828 podStartE2EDuration="21.982063484s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.578096501 +0000 UTC m=+3.351119867" lastFinishedPulling="2026-05-20 17:04:20.252470158 +0000 UTC m=+22.025493523" observedRunningTime="2026-05-20 17:04:20.982034586 +0000 UTC m=+22.755057972" watchObservedRunningTime="2026-05-20 17:04:20.982063484 +0000 UTC m=+22.755086848" May 20 17:04:20.982321 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:20.982301 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-67.ec2.internal" podStartSLOduration=20.982294074 podStartE2EDuration="20.982294074s" podCreationTimestamp="2026-05-20 17:04:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:04:03.947398315 +0000 UTC m=+5.720421702" watchObservedRunningTime="2026-05-20 17:04:20.982294074 +0000 UTC m=+22.755317459" May 20 17:04:21.056553 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.056441 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hqpxq" podStartSLOduration=4.381627736 podStartE2EDuration="23.056427847s" podCreationTimestamp="2026-05-20 17:03:58 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.579032486 +0000 UTC m=+3.352055852" lastFinishedPulling="2026-05-20 17:04:20.253832584 +0000 UTC m=+22.026855963" observedRunningTime="2026-05-20 17:04:21.040137135 +0000 UTC m=+22.813160520" watchObservedRunningTime="2026-05-20 17:04:21.056427847 +0000 UTC m=+22.829451210" May 20 17:04:21.057003 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.056971 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-4fbsw" podStartSLOduration=3.3658666950000002 podStartE2EDuration="22.056962712s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.574332439 +0000 UTC m=+3.347355802" lastFinishedPulling="2026-05-20 17:04:20.265428456 +0000 UTC m=+22.038451819" observedRunningTime="2026-05-20 17:04:21.056563394 +0000 UTC m=+22.829586779" watchObservedRunningTime="2026-05-20 17:04:21.056962712 +0000 UTC m=+22.829986097" May 20 17:04:21.071219 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.071173 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-c4prt" podStartSLOduration=3.4024265590000002 podStartE2EDuration="22.071157844s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.584686908 +0000 UTC m=+3.357710272" lastFinishedPulling="2026-05-20 17:04:20.253418194 +0000 UTC m=+22.026441557" observedRunningTime="2026-05-20 17:04:21.070937177 +0000 UTC m=+22.843960564" watchObservedRunningTime="2026-05-20 17:04:21.071157844 +0000 UTC m=+22.844181230" May 20 17:04:21.084895 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.084836 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wm24m" podStartSLOduration=11.681758391 podStartE2EDuration="22.084823294s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.585050916 +0000 UTC m=+3.358074293" lastFinishedPulling="2026-05-20 17:04:11.988115824 +0000 UTC m=+13.761139196" observedRunningTime="2026-05-20 17:04:21.084467971 +0000 UTC m=+22.857491367" watchObservedRunningTime="2026-05-20 17:04:21.084823294 +0000 UTC m=+22.857846657" May 20 17:04:21.520304 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.520126 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 17:04:21.807142 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.806887 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T17:04:21.520302144Z","UUID":"cf2d637f-ecc2-446b-9414-c5ecfe84b1ad","Handler":null,"Name":"","Endpoint":""} May 20 17:04:21.810847 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.810816 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 17:04:21.810989 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.810855 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 17:04:21.978148 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.978106 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kw45v" event={"ID":"24b4410e-71fa-4734-bc03-e9673a77bf97","Type":"ContainerStarted","Data":"f11059527f478df1bff4c84a53709c7a2ecc019f586f7f8dffcdadae7bb69b4a"} May 20 17:04:21.980108 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.979769 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" event={"ID":"46bacf5d-9206-4bc5-9831-a02ebc5f4077","Type":"ContainerStarted","Data":"409b92f451c5f872b5d102609b009a8a35ce8dabee034fe55b2f109893393e4f"} May 20 17:04:21.991916 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:21.991847 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kw45v" podStartSLOduration=4.311228709 podStartE2EDuration="22.991831936s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.571427333 +0000 UTC m=+3.344450696" lastFinishedPulling="2026-05-20 17:04:20.252030544 +0000 UTC m=+22.025053923" observedRunningTime="2026-05-20 17:04:21.991416646 +0000 UTC m=+23.764440031" watchObservedRunningTime="2026-05-20 17:04:21.991831936 +0000 UTC m=+23.764855322" May 20 17:04:22.868717 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:22.868682 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:22.868941 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:22.868690 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:22.868941 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:22.868782 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:22.868941 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:22.868899 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:22.986593 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:22.986558 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"ba5c0ca764d6f5d7e26d16438f4d99f39ac97cd77e8d4cf6d6beda4446c3a609"} May 20 17:04:22.988997 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:22.988950 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" event={"ID":"46bacf5d-9206-4bc5-9831-a02ebc5f4077","Type":"ContainerStarted","Data":"b9733d4b2f339f8c0a40a64c6bcee53fe4a8c9b2e61d9f6e2964d31876f928b2"} May 20 17:04:23.005432 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:23.005384 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5v9d" podStartSLOduration=3.144177064 podStartE2EDuration="24.00537043s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.585022045 +0000 UTC m=+3.358045414" lastFinishedPulling="2026-05-20 17:04:22.446215403 +0000 UTC m=+24.219238780" observedRunningTime="2026-05-20 17:04:23.005167678 +0000 UTC m=+24.778191064" watchObservedRunningTime="2026-05-20 17:04:23.00537043 +0000 UTC m=+24.778393845" May 20 17:04:24.868340 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:24.868307 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:24.869071 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:24.868345 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:24.869071 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:24.868415 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:24.869071 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:24.868546 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:25.822684 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:25.822648 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:25.823935 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:25.823918 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:25.998112 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:25.997732 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" event={"ID":"a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe","Type":"ContainerStarted","Data":"2c7cba5ba4f46b3652caccfd87578cbe77672b7ce0092728001bb5c5c8711427"} May 20 17:04:25.999371 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:25.998123 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:25.999371 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:25.998230 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:25.999371 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:25.998249 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:25.999371 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:25.998959 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vtgxs" May 20 17:04:26.016364 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:26.015514 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:26.026113 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:26.026075 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" podStartSLOduration=8.303548825 podStartE2EDuration="27.026060993s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.580939784 +0000 UTC m=+3.353963157" lastFinishedPulling="2026-05-20 17:04:20.303451959 +0000 UTC m=+22.076475325" observedRunningTime="2026-05-20 17:04:26.025414917 +0000 UTC m=+27.798438294" watchObservedRunningTime="2026-05-20 17:04:26.026060993 +0000 UTC m=+27.799084377" May 20 17:04:26.868572 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:26.868537 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:26.868760 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:26.868537 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:26.868760 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:26.868646 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:26.868760 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:26.868719 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:27.001477 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:27.001441 2563 generic.go:358] "Generic (PLEG): container finished" podID="5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8" containerID="5dfba3665368bf73c0a7e6199d289847c7be9ea5febb6ed4fe0a3d185214c6d6" exitCode=0 May 20 17:04:27.001951 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:27.001540 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" event={"ID":"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8","Type":"ContainerDied","Data":"5dfba3665368bf73c0a7e6199d289847c7be9ea5febb6ed4fe0a3d185214c6d6"} May 20 17:04:27.002248 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:27.002232 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:27.019676 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:27.019649 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:04:27.950638 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:27.950355 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2knvn"] May 20 17:04:27.950763 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:27.950730 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:27.950861 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:27.950837 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:27.951634 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:27.951612 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gs5mr"] May 20 17:04:27.951741 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:27.951727 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:27.951892 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:27.951839 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:29.006284 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:29.006247 2563 generic.go:358] "Generic (PLEG): container finished" podID="5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8" containerID="b60cf38eb3694c1987228738d7cc32679161dabb130890bdc24aca9a223c9bde" exitCode=0 May 20 17:04:29.006785 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:29.006336 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" event={"ID":"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8","Type":"ContainerDied","Data":"b60cf38eb3694c1987228738d7cc32679161dabb130890bdc24aca9a223c9bde"} May 20 17:04:29.869100 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:29.869060 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:29.869236 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:29.869187 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:29.869272 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:29.869239 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:29.869351 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:29.869332 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:31.016837 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:31.016805 2563 generic.go:358] "Generic (PLEG): container finished" podID="5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8" containerID="3dd28621f0058fcbcefef3bb583d51051ab5cda3fb76d4059198deb513965541" exitCode=0 May 20 17:04:31.017403 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:31.016862 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" event={"ID":"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8","Type":"ContainerDied","Data":"3dd28621f0058fcbcefef3bb583d51051ab5cda3fb76d4059198deb513965541"} May 20 17:04:31.868891 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:31.868830 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:31.869192 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:31.868893 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:31.869192 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:31.869001 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gs5mr" podUID="e6b2eeb9-1b45-4073-a920-6e63f19c9384" May 20 17:04:31.869192 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:31.869136 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2knvn" podUID="79a1e756-5525-42f1-84e6-1c066b38a115" May 20 17:04:32.488852 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:32.488814 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:32.489349 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:32.488968 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:32.489349 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:32.489045 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs podName:e6b2eeb9-1b45-4073-a920-6e63f19c9384 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:04.489023695 +0000 UTC m=+66.262047061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs") pod "network-metrics-daemon-gs5mr" (UID: "e6b2eeb9-1b45-4073-a920-6e63f19c9384") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:04:32.690316 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:32.690271 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:32.690492 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:32.690450 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:04:32.690492 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:32.690477 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:04:32.690492 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:32.690490 2563 projected.go:194] Error preparing data for projected volume kube-api-access-mpkw8 for pod openshift-network-diagnostics/network-check-target-2knvn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:32.690614 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:32.690560 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8 podName:79a1e756-5525-42f1-84e6-1c066b38a115 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:04.690538774 +0000 UTC m=+66.463562140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkw8" (UniqueName: "kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8") pod "network-check-target-2knvn" (UID: "79a1e756-5525-42f1-84e6-1c066b38a115") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:04:33.067353 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.067319 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-67.ec2.internal" event="NodeReady" May 20 17:04:33.067532 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.067470 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 17:04:33.111598 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.111564 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4vxws"] May 20 17:04:33.140066 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.140026 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5jtr8"] May 20 17:04:33.140228 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.140163 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.142854 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.142829 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 17:04:33.143005 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.142911 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 17:04:33.143172 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.143157 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qmxjm\"" May 20 17:04:33.156511 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.156489 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4vxws"] May 20 17:04:33.156646 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.156516 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jtr8"] May 20 17:04:33.156709 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.156651 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:33.159345 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.159187 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 17:04:33.159345 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.159203 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4kg2\"" May 20 17:04:33.159345 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.159218 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 17:04:33.159345 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.159229 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 17:04:33.294624 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.294582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.294794 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.294643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a259a15-bf9c-4bd2-87fb-08aa32422e37-tmp-dir\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.294794 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.294735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:33.294794 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.294768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv49p\" (UniqueName: \"kubernetes.io/projected/91924491-1822-4ff1-8759-17da34aeffb6-kube-api-access-sv49p\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:33.294794 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.294787 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frn2v\" (UniqueName: \"kubernetes.io/projected/9a259a15-bf9c-4bd2-87fb-08aa32422e37-kube-api-access-frn2v\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.295054 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.294861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a259a15-bf9c-4bd2-87fb-08aa32422e37-config-volume\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.396039 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.395948 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.396039 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.396014 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a259a15-bf9c-4bd2-87fb-08aa32422e37-tmp-dir\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.396268 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.396058 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:33.396268 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.396086 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sv49p\" (UniqueName: \"kubernetes.io/projected/91924491-1822-4ff1-8759-17da34aeffb6-kube-api-access-sv49p\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:33.396268 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.396110 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frn2v\" (UniqueName: \"kubernetes.io/projected/9a259a15-bf9c-4bd2-87fb-08aa32422e37-kube-api-access-frn2v\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.396268 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:33.396117 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:04:33.396268 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.396143 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a259a15-bf9c-4bd2-87fb-08aa32422e37-config-volume\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.396268 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:33.396207 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls podName:9a259a15-bf9c-4bd2-87fb-08aa32422e37 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:33.896189729 +0000 UTC m=+35.669213104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls") pod "dns-default-4vxws" (UID: "9a259a15-bf9c-4bd2-87fb-08aa32422e37") : secret "dns-default-metrics-tls" not found May 20 17:04:33.396592 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:33.396467 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:04:33.396592 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:33.396502 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert podName:91924491-1822-4ff1-8759-17da34aeffb6 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:33.896492664 +0000 UTC m=+35.669516027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert") pod "ingress-canary-5jtr8" (UID: "91924491-1822-4ff1-8759-17da34aeffb6") : secret "canary-serving-cert" not found May 20 17:04:33.397166 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.396711 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a259a15-bf9c-4bd2-87fb-08aa32422e37-tmp-dir\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.397166 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.396756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9a259a15-bf9c-4bd2-87fb-08aa32422e37-config-volume\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.407509 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.407483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frn2v\" (UniqueName: \"kubernetes.io/projected/9a259a15-bf9c-4bd2-87fb-08aa32422e37-kube-api-access-frn2v\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.407671 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.407538 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv49p\" (UniqueName: \"kubernetes.io/projected/91924491-1822-4ff1-8759-17da34aeffb6-kube-api-access-sv49p\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:33.868798 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.868763 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:04:33.869287 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.868763 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:04:33.871753 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.871495 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 17:04:33.871753 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.871515 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phplh\"" May 20 17:04:33.871753 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.871562 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 17:04:33.872737 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.872713 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhsxl\"" May 20 17:04:33.872841 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.872764 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 17:04:33.899367 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.899329 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:33.899558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:33.899408 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:33.899558 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:33.899490 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:04:33.899558 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:33.899500 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:04:33.899716 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:33.899563 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls podName:9a259a15-bf9c-4bd2-87fb-08aa32422e37 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:34.899544736 +0000 UTC m=+36.672568105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls") pod "dns-default-4vxws" (UID: "9a259a15-bf9c-4bd2-87fb-08aa32422e37") : secret "dns-default-metrics-tls" not found May 20 17:04:33.899716 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:33.899578 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert podName:91924491-1822-4ff1-8759-17da34aeffb6 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:34.899571696 +0000 UTC m=+36.672595058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert") pod "ingress-canary-5jtr8" (UID: "91924491-1822-4ff1-8759-17da34aeffb6") : secret "canary-serving-cert" not found May 20 17:04:34.908180 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:34.908137 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:34.908591 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:34.908206 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:34.908591 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:34.908310 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:04:34.908591 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:34.908382 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls podName:9a259a15-bf9c-4bd2-87fb-08aa32422e37 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:36.908366353 +0000 UTC m=+38.681389719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls") pod "dns-default-4vxws" (UID: "9a259a15-bf9c-4bd2-87fb-08aa32422e37") : secret "dns-default-metrics-tls" not found May 20 17:04:34.908591 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:34.908310 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:04:34.908591 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:34.908441 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert podName:91924491-1822-4ff1-8759-17da34aeffb6 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:36.908429896 +0000 UTC m=+38.681453259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert") pod "ingress-canary-5jtr8" (UID: "91924491-1822-4ff1-8759-17da34aeffb6") : secret "canary-serving-cert" not found May 20 17:04:36.924858 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:36.924821 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:36.925336 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:36.924904 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:36.925336 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:36.925005 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:04:36.925336 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:36.925017 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:04:36.925336 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:36.925075 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert podName:91924491-1822-4ff1-8759-17da34aeffb6 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:40.925055898 +0000 UTC m=+42.698079343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert") pod "ingress-canary-5jtr8" (UID: "91924491-1822-4ff1-8759-17da34aeffb6") : secret "canary-serving-cert" not found May 20 17:04:36.925336 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:36.925089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls podName:9a259a15-bf9c-4bd2-87fb-08aa32422e37 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:40.925083639 +0000 UTC m=+42.698107001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls") pod "dns-default-4vxws" (UID: "9a259a15-bf9c-4bd2-87fb-08aa32422e37") : secret "dns-default-metrics-tls" not found May 20 17:04:38.033148 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:38.033115 2563 generic.go:358] "Generic (PLEG): container finished" podID="5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8" containerID="620f33ddd124c87cb551c10088dce0aa68189b2ebfe1a7d98a7c225ec2cba795" exitCode=0 May 20 17:04:38.033512 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:38.033159 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" event={"ID":"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8","Type":"ContainerDied","Data":"620f33ddd124c87cb551c10088dce0aa68189b2ebfe1a7d98a7c225ec2cba795"} May 20 17:04:39.037125 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:39.037091 2563 generic.go:358] "Generic (PLEG): container finished" podID="5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8" containerID="c9d5742fd2e34995d89d087e9e3f6c411ea6697efb3a727d114f7990620630e4" exitCode=0 May 20 17:04:39.037542 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:39.037153 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" event={"ID":"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8","Type":"ContainerDied","Data":"c9d5742fd2e34995d89d087e9e3f6c411ea6697efb3a727d114f7990620630e4"} May 20 17:04:40.042016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:40.041977 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" event={"ID":"5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8","Type":"ContainerStarted","Data":"0cb7b4ffee81300f48b470b1ad558c606f9513c264a3f7c38e48b8e611353afa"} May 20 17:04:40.065617 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:40.065568 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9wdk7" podStartSLOduration=5.360857382 podStartE2EDuration="41.065553037s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:04:01.588116172 +0000 UTC m=+3.361139539" lastFinishedPulling="2026-05-20 17:04:37.292811828 +0000 UTC m=+39.065835194" observedRunningTime="2026-05-20 17:04:40.064019553 +0000 UTC m=+41.837042938" watchObservedRunningTime="2026-05-20 17:04:40.065553037 +0000 UTC m=+41.838576432" May 20 17:04:40.957122 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:40.957070 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:40.957314 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:40.957146 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:40.957314 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:40.957222 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:04:40.957314 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:40.957229 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:04:40.957314 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:40.957284 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls podName:9a259a15-bf9c-4bd2-87fb-08aa32422e37 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:48.957270601 +0000 UTC m=+50.730293964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls") pod "dns-default-4vxws" (UID: "9a259a15-bf9c-4bd2-87fb-08aa32422e37") : secret "dns-default-metrics-tls" not found May 20 17:04:40.957314 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:40.957297 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert podName:91924491-1822-4ff1-8759-17da34aeffb6 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:48.957291446 +0000 UTC m=+50.730314808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert") pod "ingress-canary-5jtr8" (UID: "91924491-1822-4ff1-8759-17da34aeffb6") : secret "canary-serving-cert" not found May 20 17:04:49.013140 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:49.013082 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:04:49.013722 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:49.013182 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:04:49.013722 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:49.013237 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:04:49.013722 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:49.013295 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:04:49.013722 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:49.013313 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls podName:9a259a15-bf9c-4bd2-87fb-08aa32422e37 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:05.013298098 +0000 UTC m=+66.786321466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls") pod "dns-default-4vxws" (UID: "9a259a15-bf9c-4bd2-87fb-08aa32422e37") : secret "dns-default-metrics-tls" not found May 20 17:04:49.013722 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:04:49.013344 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert podName:91924491-1822-4ff1-8759-17da34aeffb6 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:05.013328946 +0000 UTC m=+66.786352309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert") pod "ingress-canary-5jtr8" (UID: "91924491-1822-4ff1-8759-17da34aeffb6") : secret "canary-serving-cert" not found May 20 17:04:59.026018 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:04:59.025986 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm5q4" May 20 17:05:04.520119 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.520073 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:05:04.522769 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.522745 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 17:05:04.530834 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:04.530812 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 17:05:04.530933 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:04.530898 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs podName:e6b2eeb9-1b45-4073-a920-6e63f19c9384 nodeName:}" failed. No retries permitted until 2026-05-20 17:06:08.530859091 +0000 UTC m=+130.303882454 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs") pod "network-metrics-daemon-gs5mr" (UID: "e6b2eeb9-1b45-4073-a920-6e63f19c9384") : secret "metrics-daemon-secret" not found May 20 17:05:04.721917 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.721842 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:05:04.724979 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.724959 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 17:05:04.734776 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.734752 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 17:05:04.746163 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.746137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpkw8\" (UniqueName: \"kubernetes.io/projected/79a1e756-5525-42f1-84e6-1c066b38a115-kube-api-access-mpkw8\") pod \"network-check-target-2knvn\" (UID: \"79a1e756-5525-42f1-84e6-1c066b38a115\") " pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:05:04.784496 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.784404 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhsxl\"" May 20 17:05:04.792435 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.792402 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:05:04.931267 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:04.931231 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2knvn"] May 20 17:05:04.934757 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:04.934727 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a1e756_5525_42f1_84e6_1c066b38a115.slice/crio-653ba581f9f490768d87d73c1a7857ee74a0ed96d1a50460d5c7efc67abb8261 WatchSource:0}: Error finding container 653ba581f9f490768d87d73c1a7857ee74a0ed96d1a50460d5c7efc67abb8261: Status 404 returned error can't find the container with id 653ba581f9f490768d87d73c1a7857ee74a0ed96d1a50460d5c7efc67abb8261 May 20 17:05:05.023818 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:05.023783 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:05:05.024035 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:05.023839 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:05:05.024035 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:05.023946 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:05:05.024035 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:05.023959 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:05:05.024035 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:05.024009 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert podName:91924491-1822-4ff1-8759-17da34aeffb6 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:37.0239949 +0000 UTC m=+98.797018263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert") pod "ingress-canary-5jtr8" (UID: "91924491-1822-4ff1-8759-17da34aeffb6") : secret "canary-serving-cert" not found May 20 17:05:05.024035 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:05.024022 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls podName:9a259a15-bf9c-4bd2-87fb-08aa32422e37 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:37.024015606 +0000 UTC m=+98.797038968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls") pod "dns-default-4vxws" (UID: "9a259a15-bf9c-4bd2-87fb-08aa32422e37") : secret "dns-default-metrics-tls" not found May 20 17:05:05.091219 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:05.091178 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2knvn" event={"ID":"79a1e756-5525-42f1-84e6-1c066b38a115","Type":"ContainerStarted","Data":"653ba581f9f490768d87d73c1a7857ee74a0ed96d1a50460d5c7efc67abb8261"} May 20 17:05:08.098905 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:08.098848 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2knvn" event={"ID":"79a1e756-5525-42f1-84e6-1c066b38a115","Type":"ContainerStarted","Data":"ff4ebb5943514996e974f76e68690c5b13e5c35e7b448107df8899804265459a"} May 20 17:05:08.099260 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:08.099023 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:05:08.114609 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:08.114561 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2knvn" podStartSLOduration=66.44385632 podStartE2EDuration="1m9.114545562s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:05:04.936758795 +0000 UTC m=+66.709782159" lastFinishedPulling="2026-05-20 17:05:07.607448035 +0000 UTC m=+69.380471401" observedRunningTime="2026-05-20 17:05:08.113627811 +0000 UTC m=+69.886651199" watchObservedRunningTime="2026-05-20 17:05:08.114545562 +0000 UTC m=+69.887568947" May 20 17:05:19.721013 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.720896 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q"] May 20 17:05:19.723068 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.723051 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:19.724480 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.724459 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-6sfd6"] May 20 17:05:19.725507 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.725485 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kwsfd\"" May 20 17:05:19.726157 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.726144 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.728158 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.728140 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 17:05:19.728267 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.728185 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 20 17:05:19.728267 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.728140 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 17:05:19.728267 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.728144 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 20 17:05:19.728426 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.728358 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dj88b\"" May 20 17:05:19.728476 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.728446 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 20 17:05:19.729122 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.729102 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 17:05:19.729414 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.729399 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 20 17:05:19.729495 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.729479 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 17:05:19.734000 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.733860 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 20 17:05:19.734375 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.734356 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q"] May 20 17:05:19.737842 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.737553 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-6sfd6"] May 20 17:05:19.823794 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.823760 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt"] May 20 17:05:19.825479 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.825463 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt" May 20 17:05:19.827806 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.827783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.827963 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.827819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-tmp\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.827963 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.827901 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 20 17:05:19.827963 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.827917 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 20 17:05:19.827963 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.827918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wf2g\" (UniqueName: \"kubernetes.io/projected/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-kube-api-access-7wf2g\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:19.827963 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.827954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-snapshots\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.828147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.827967 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nxzhk\"" May 20 17:05:19.828147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.827977 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.828147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.828026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:19.828147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.828054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:19.828147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.828100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl7k7\" (UniqueName: \"kubernetes.io/projected/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-kube-api-access-zl7k7\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.828147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.828139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-serving-cert\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.830671 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.830538 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65"] May 20 17:05:19.832511 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.832492 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:19.834731 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.834712 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb"] May 20 17:05:19.835369 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.835354 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 20 17:05:19.835928 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.835913 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-s7j47\"" May 20 17:05:19.836013 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.835989 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 20 17:05:19.836553 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.836536 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 20 17:05:19.836781 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.836762 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-bkxs2"] May 20 17:05:19.836944 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.836930 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:19.839208 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.838825 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt"] May 20 17:05:19.839208 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.838952 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:19.839410 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.839391 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 20 17:05:19.839523 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.839441 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x2bpb\"" May 20 17:05:19.839951 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.839933 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 20 17:05:19.840048 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.839954 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 20 17:05:19.840048 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.839936 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 20 17:05:19.842258 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.841966 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xf4xh\"" May 20 17:05:19.842258 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.841983 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 20 17:05:19.842258 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.841999 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 20 17:05:19.842258 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.842012 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 20 17:05:19.842258 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.842046 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 20 17:05:19.850230 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.850205 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65"] May 20 17:05:19.850558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.850534 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 20 17:05:19.851135 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.851109 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb"] May 20 17:05:19.852190 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.852170 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-bkxs2"] May 20 17:05:19.923530 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.923493 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx"] May 20 17:05:19.925369 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.925352 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:19.928763 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.928737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5ls\" (UniqueName: \"kubernetes.io/projected/7b07d22d-9ba8-473c-a06b-20232e88379e-kube-api-access-vk5ls\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:19.928918 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.928775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65c6ed2-d28c-4dab-b193-fe8e9088861c-trusted-ca\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:19.928918 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.928807 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wf2g\" (UniqueName: \"kubernetes.io/projected/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-kube-api-access-7wf2g\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:19.928918 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.928833 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-snapshots\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.928918 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.928857 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.928918 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.928900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b07d22d-9ba8-473c-a06b-20232e88379e-config\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:19.929176 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.928962 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:19.929176 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5xx\" (UniqueName: \"kubernetes.io/projected/b2f515aa-3050-4ec9-851a-0a51c74535d3-kube-api-access-9k5xx\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:19.929176 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lpfq\" (UniqueName: \"kubernetes.io/projected/a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1-kube-api-access-8lpfq\") pod \"volume-data-source-validator-5cf8c89d64-sk6pt\" (UID: \"a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt" May 20 17:05:19.929176 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b07d22d-9ba8-473c-a06b-20232e88379e-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:19.929176 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929123 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:19.929176 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929150 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl7k7\" (UniqueName: \"kubernetes.io/projected/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-kube-api-access-zl7k7\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.929461 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929184 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-serving-cert\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.929461 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:19.929461 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65c6ed2-d28c-4dab-b193-fe8e9088861c-config\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:19.929461 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929273 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.929461 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:19.929289 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 17:05:19.929461 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:19.929368 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls podName:bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e nodeName:}" failed. No retries permitted until 2026-05-20 17:05:20.429348705 +0000 UTC m=+82.202372068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t2h2q" (UID: "bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e") : secret "cluster-monitoring-operator-tls" not found May 20 17:05:19.929461 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65c6ed2-d28c-4dab-b193-fe8e9088861c-serving-cert\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:19.929461 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929450 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-tmp\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.929834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65lft\" (UniqueName: \"kubernetes.io/projected/d65c6ed2-d28c-4dab-b193-fe8e9088861c-kube-api-access-65lft\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:19.929834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-snapshots\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.929834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.929834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929714 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:19.929834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.929812 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-tmp\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.930109 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.930090 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 20 17:05:19.930161 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.930111 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 20 17:05:19.930380 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.930158 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 20 17:05:19.930380 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.930186 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.930567 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.930549 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kk4qm\"" May 20 17:05:19.930621 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.930550 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 20 17:05:19.932147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.932052 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-serving-cert\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.938086 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.938062 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx"] May 20 17:05:19.944387 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.944357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl7k7\" (UniqueName: \"kubernetes.io/projected/fdaa5d89-3dfc-44ed-b29a-cc95026827d9-kube-api-access-zl7k7\") pod \"insights-operator-78bdfb888c-6sfd6\" (UID: \"fdaa5d89-3dfc-44ed-b29a-cc95026827d9\") " pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:19.944532 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:19.944517 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wf2g\" (UniqueName: \"kubernetes.io/projected/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-kube-api-access-7wf2g\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:20.030273 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030187 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5xx\" (UniqueName: \"kubernetes.io/projected/b2f515aa-3050-4ec9-851a-0a51c74535d3-kube-api-access-9k5xx\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:20.030273 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030232 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpfq\" (UniqueName: \"kubernetes.io/projected/a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1-kube-api-access-8lpfq\") pod \"volume-data-source-validator-5cf8c89d64-sk6pt\" (UID: \"a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt" May 20 17:05:20.030273 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030252 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b07d22d-9ba8-473c-a06b-20232e88379e-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:20.030558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030302 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:20.030558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030327 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65c6ed2-d28c-4dab-b193-fe8e9088861c-config\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.030558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030353 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65c6ed2-d28c-4dab-b193-fe8e9088861c-serving-cert\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.030558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-config\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.030558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030411 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65lft\" (UniqueName: \"kubernetes.io/projected/d65c6ed2-d28c-4dab-b193-fe8e9088861c-kube-api-access-65lft\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.030558 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:20.030458 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 17:05:20.030558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030501 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5ls\" (UniqueName: \"kubernetes.io/projected/7b07d22d-9ba8-473c-a06b-20232e88379e-kube-api-access-vk5ls\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:20.030558 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:20.030542 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls podName:b2f515aa-3050-4ec9-851a-0a51c74535d3 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:20.530520179 +0000 UTC m=+82.303543566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls") pod "cluster-samples-operator-697587599-q5t65" (UID: "b2f515aa-3050-4ec9-851a-0a51c74535d3") : secret "samples-operator-tls" not found May 20 17:05:20.030986 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-serving-cert\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.030986 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030619 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65c6ed2-d28c-4dab-b193-fe8e9088861c-trusted-ca\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.030986 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnj2\" (UniqueName: \"kubernetes.io/projected/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-kube-api-access-lfnj2\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.030986 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.030699 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b07d22d-9ba8-473c-a06b-20232e88379e-config\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:20.031289 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.031269 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b07d22d-9ba8-473c-a06b-20232e88379e-config\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:20.031349 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.031302 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65c6ed2-d28c-4dab-b193-fe8e9088861c-trusted-ca\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.031434 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.031410 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65c6ed2-d28c-4dab-b193-fe8e9088861c-config\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.032774 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.032757 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65c6ed2-d28c-4dab-b193-fe8e9088861c-serving-cert\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.032836 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.032819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b07d22d-9ba8-473c-a06b-20232e88379e-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:20.040463 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.040428 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" May 20 17:05:20.040774 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.040746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65lft\" (UniqueName: \"kubernetes.io/projected/d65c6ed2-d28c-4dab-b193-fe8e9088861c-kube-api-access-65lft\") pod \"console-operator-76dff48d59-bkxs2\" (UID: \"d65c6ed2-d28c-4dab-b193-fe8e9088861c\") " pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.041429 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.041268 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lpfq\" (UniqueName: \"kubernetes.io/projected/a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1-kube-api-access-8lpfq\") pod \"volume-data-source-validator-5cf8c89d64-sk6pt\" (UID: \"a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt" May 20 17:05:20.041775 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.041750 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5xx\" (UniqueName: \"kubernetes.io/projected/b2f515aa-3050-4ec9-851a-0a51c74535d3-kube-api-access-9k5xx\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:20.041854 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.041774 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5ls\" (UniqueName: \"kubernetes.io/projected/7b07d22d-9ba8-473c-a06b-20232e88379e-kube-api-access-vk5ls\") pod \"kube-storage-version-migrator-operator-565644f49-fcqrb\" (UID: \"7b07d22d-9ba8-473c-a06b-20232e88379e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:20.132471 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.132439 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-config\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.132652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.132497 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-serving-cert\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.132652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.132517 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnj2\" (UniqueName: \"kubernetes.io/projected/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-kube-api-access-lfnj2\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.133070 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.133044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-config\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.134690 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.134667 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt" May 20 17:05:20.134839 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.134821 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-serving-cert\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.141410 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.141378 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnj2\" (UniqueName: \"kubernetes.io/projected/65b4a295-6e8b-4265-bad2-f30eb0fe88b5-kube-api-access-lfnj2\") pod \"service-ca-operator-57b5b68b8-xpgqx\" (UID: \"65b4a295-6e8b-4265-bad2-f30eb0fe88b5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.154583 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.154551 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" May 20 17:05:20.160118 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.160087 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:20.163774 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.163737 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-6sfd6"] May 20 17:05:20.167466 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:20.167417 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdaa5d89_3dfc_44ed_b29a_cc95026827d9.slice/crio-e2001416cf2e8515bcc2fc5b521834a35ff54cf8303432b56b097cf49e753c67 WatchSource:0}: Error finding container e2001416cf2e8515bcc2fc5b521834a35ff54cf8303432b56b097cf49e753c67: Status 404 returned error can't find the container with id e2001416cf2e8515bcc2fc5b521834a35ff54cf8303432b56b097cf49e753c67 May 20 17:05:20.239204 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.238911 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" May 20 17:05:20.289660 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.289580 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt"] May 20 17:05:20.292948 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:20.292843 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c132d6_9fc0_49f2_a5ed_79b4fb48caf1.slice/crio-8338cfcdf81a276e65f5a7df1405dd42a4a29f9ff0586703486a060bf3b5b3a2 WatchSource:0}: Error finding container 8338cfcdf81a276e65f5a7df1405dd42a4a29f9ff0586703486a060bf3b5b3a2: Status 404 returned error can't find the container with id 8338cfcdf81a276e65f5a7df1405dd42a4a29f9ff0586703486a060bf3b5b3a2 May 20 17:05:20.303014 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.302595 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb"] May 20 17:05:20.307900 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:20.307835 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b07d22d_9ba8_473c_a06b_20232e88379e.slice/crio-4c7e51884347626a3f4c873710e89cec41243465c33555ba9f7cad1917440d58 WatchSource:0}: Error finding container 4c7e51884347626a3f4c873710e89cec41243465c33555ba9f7cad1917440d58: Status 404 returned error can't find the container with id 4c7e51884347626a3f4c873710e89cec41243465c33555ba9f7cad1917440d58 May 20 17:05:20.327442 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.327372 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-bkxs2"] May 20 17:05:20.329793 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:20.329766 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65c6ed2_d28c_4dab_b193_fe8e9088861c.slice/crio-5991a8b7ba14c18bdb73c01de08eda81a3adf73310bdeb6b84adf4829e8c759d WatchSource:0}: Error finding container 5991a8b7ba14c18bdb73c01de08eda81a3adf73310bdeb6b84adf4829e8c759d: Status 404 returned error can't find the container with id 5991a8b7ba14c18bdb73c01de08eda81a3adf73310bdeb6b84adf4829e8c759d May 20 17:05:20.382950 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.382920 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx"] May 20 17:05:20.385980 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:20.385953 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b4a295_6e8b_4265_bad2_f30eb0fe88b5.slice/crio-0abdec68360f150fe359b6aded78b181ab7d9757f35bfa8aa5124507b27e4aa0 WatchSource:0}: Error finding container 0abdec68360f150fe359b6aded78b181ab7d9757f35bfa8aa5124507b27e4aa0: Status 404 returned error can't find the container with id 0abdec68360f150fe359b6aded78b181ab7d9757f35bfa8aa5124507b27e4aa0 May 20 17:05:20.435890 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.435826 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:20.436054 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:20.435970 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 17:05:20.436054 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:20.436034 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls podName:bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e nodeName:}" failed. No retries permitted until 2026-05-20 17:05:21.436016188 +0000 UTC m=+83.209039551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t2h2q" (UID: "bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e") : secret "cluster-monitoring-operator-tls" not found May 20 17:05:20.536914 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:20.536854 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:20.537067 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:20.537005 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 17:05:20.537107 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:20.537076 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls podName:b2f515aa-3050-4ec9-851a-0a51c74535d3 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:21.537058927 +0000 UTC m=+83.310082295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls") pod "cluster-samples-operator-697587599-q5t65" (UID: "b2f515aa-3050-4ec9-851a-0a51c74535d3") : secret "samples-operator-tls" not found May 20 17:05:21.126182 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:21.126138 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt" event={"ID":"a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1","Type":"ContainerStarted","Data":"8338cfcdf81a276e65f5a7df1405dd42a4a29f9ff0586703486a060bf3b5b3a2"} May 20 17:05:21.127661 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:21.127612 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" event={"ID":"7b07d22d-9ba8-473c-a06b-20232e88379e","Type":"ContainerStarted","Data":"4c7e51884347626a3f4c873710e89cec41243465c33555ba9f7cad1917440d58"} May 20 17:05:21.129326 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:21.129237 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" event={"ID":"fdaa5d89-3dfc-44ed-b29a-cc95026827d9","Type":"ContainerStarted","Data":"e2001416cf2e8515bcc2fc5b521834a35ff54cf8303432b56b097cf49e753c67"} May 20 17:05:21.131217 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:21.131161 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" event={"ID":"65b4a295-6e8b-4265-bad2-f30eb0fe88b5","Type":"ContainerStarted","Data":"0abdec68360f150fe359b6aded78b181ab7d9757f35bfa8aa5124507b27e4aa0"} May 20 17:05:21.134167 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:21.134094 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" event={"ID":"d65c6ed2-d28c-4dab-b193-fe8e9088861c","Type":"ContainerStarted","Data":"5991a8b7ba14c18bdb73c01de08eda81a3adf73310bdeb6b84adf4829e8c759d"} May 20 17:05:21.448726 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:21.448630 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:21.448923 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:21.448777 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 17:05:21.448923 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:21.448845 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls podName:bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e nodeName:}" failed. No retries permitted until 2026-05-20 17:05:23.448823338 +0000 UTC m=+85.221846715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t2h2q" (UID: "bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e") : secret "cluster-monitoring-operator-tls" not found May 20 17:05:21.549417 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:21.549142 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:21.549417 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:21.549324 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 17:05:21.549417 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:21.549394 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls podName:b2f515aa-3050-4ec9-851a-0a51c74535d3 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:23.549372065 +0000 UTC m=+85.322395431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls") pod "cluster-samples-operator-697587599-q5t65" (UID: "b2f515aa-3050-4ec9-851a-0a51c74535d3") : secret "samples-operator-tls" not found May 20 17:05:23.141245 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:23.141205 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt" event={"ID":"a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1","Type":"ContainerStarted","Data":"a6435736b5c88de0116d6bf7cc81f9ae8ed297021f7563ecaea2d176e4c48a44"} May 20 17:05:23.156770 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:23.156719 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-sk6pt" podStartSLOduration=2.282435907 podStartE2EDuration="4.156699524s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="2026-05-20 17:05:20.295098581 +0000 UTC m=+82.068121944" lastFinishedPulling="2026-05-20 17:05:22.169362195 +0000 UTC m=+83.942385561" observedRunningTime="2026-05-20 17:05:23.156154356 +0000 UTC m=+84.929177743" watchObservedRunningTime="2026-05-20 17:05:23.156699524 +0000 UTC m=+84.929722911" May 20 17:05:23.466465 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:23.466364 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:23.466637 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:23.466495 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 17:05:23.466637 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:23.466569 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls podName:bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e nodeName:}" failed. No retries permitted until 2026-05-20 17:05:27.466553375 +0000 UTC m=+89.239576738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t2h2q" (UID: "bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e") : secret "cluster-monitoring-operator-tls" not found May 20 17:05:23.567327 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:23.567281 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:23.567496 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:23.567406 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 17:05:23.567496 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:23.567475 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls podName:b2f515aa-3050-4ec9-851a-0a51c74535d3 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:27.567455935 +0000 UTC m=+89.340479323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls") pod "cluster-samples-operator-697587599-q5t65" (UID: "b2f515aa-3050-4ec9-851a-0a51c74535d3") : secret "samples-operator-tls" not found May 20 17:05:25.146439 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.146399 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" event={"ID":"65b4a295-6e8b-4265-bad2-f30eb0fe88b5","Type":"ContainerStarted","Data":"06255a029cb5454244ef312d1d622f404a290fe948080ff35610e3ad36e86705"} May 20 17:05:25.148082 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.148059 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/0.log" May 20 17:05:25.148210 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.148101 2563 generic.go:358] "Generic (PLEG): container finished" podID="d65c6ed2-d28c-4dab-b193-fe8e9088861c" containerID="cd925548d24ebc75c9e9fcde1db425697c29fb7c410426cfbceaf33bbf612f47" exitCode=255 May 20 17:05:25.148210 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.148193 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" event={"ID":"d65c6ed2-d28c-4dab-b193-fe8e9088861c","Type":"ContainerDied","Data":"cd925548d24ebc75c9e9fcde1db425697c29fb7c410426cfbceaf33bbf612f47"} May 20 17:05:25.148382 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.148366 2563 scope.go:117] "RemoveContainer" containerID="cd925548d24ebc75c9e9fcde1db425697c29fb7c410426cfbceaf33bbf612f47" May 20 17:05:25.149718 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.149675 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" event={"ID":"7b07d22d-9ba8-473c-a06b-20232e88379e","Type":"ContainerStarted","Data":"1cf6452206a6eabc45a2f7e33e8ec145ca8fd5bf288e6c885c84adc4d76eb7d7"} May 20 17:05:25.151092 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.151071 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" event={"ID":"fdaa5d89-3dfc-44ed-b29a-cc95026827d9","Type":"ContainerStarted","Data":"b6f360ea74fcc608b5f2ab4ef951ef491f3c2330163e4be23d1faf910f38600c"} May 20 17:05:25.162552 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.162490 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" podStartSLOduration=2.352513792 podStartE2EDuration="6.162473485s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="2026-05-20 17:05:20.387704749 +0000 UTC m=+82.160728112" lastFinishedPulling="2026-05-20 17:05:24.19766444 +0000 UTC m=+85.970687805" observedRunningTime="2026-05-20 17:05:25.161432206 +0000 UTC m=+86.934455590" watchObservedRunningTime="2026-05-20 17:05:25.162473485 +0000 UTC m=+86.935496849" May 20 17:05:25.196860 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.196801 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" podStartSLOduration=2.170698366 podStartE2EDuration="6.196781116s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="2026-05-20 17:05:20.169799666 +0000 UTC m=+81.942823029" lastFinishedPulling="2026-05-20 17:05:24.1958824 +0000 UTC m=+85.968905779" observedRunningTime="2026-05-20 17:05:25.195323894 +0000 UTC m=+86.968347288" watchObservedRunningTime="2026-05-20 17:05:25.196781116 +0000 UTC m=+86.969804502" May 20 17:05:25.216247 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.216198 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" podStartSLOduration=2.326228424 podStartE2EDuration="6.216182146s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="2026-05-20 17:05:20.310341439 +0000 UTC m=+82.083364807" lastFinishedPulling="2026-05-20 17:05:24.200295161 +0000 UTC m=+85.973318529" observedRunningTime="2026-05-20 17:05:25.21525312 +0000 UTC m=+86.988276511" watchObservedRunningTime="2026-05-20 17:05:25.216182146 +0000 UTC m=+86.989205532" May 20 17:05:25.844299 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.844265 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w"] May 20 17:05:25.846218 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.846197 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" May 20 17:05:25.848757 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.848729 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 20 17:05:25.849679 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.849662 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 20 17:05:25.849766 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.849662 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qsj2q\"" May 20 17:05:25.857561 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.857538 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w"] May 20 17:05:25.887824 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.887777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgzgc\" (UniqueName: \"kubernetes.io/projected/32973a7d-9edc-42d0-9a71-5c652ace1001-kube-api-access-hgzgc\") pod \"migrator-b985f5d89-mkz9w\" (UID: \"32973a7d-9edc-42d0-9a71-5c652ace1001\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" May 20 17:05:25.989063 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.989023 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hgzgc\" (UniqueName: \"kubernetes.io/projected/32973a7d-9edc-42d0-9a71-5c652ace1001-kube-api-access-hgzgc\") pod \"migrator-b985f5d89-mkz9w\" (UID: \"32973a7d-9edc-42d0-9a71-5c652ace1001\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" May 20 17:05:25.998781 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:25.998751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgzgc\" (UniqueName: \"kubernetes.io/projected/32973a7d-9edc-42d0-9a71-5c652ace1001-kube-api-access-hgzgc\") pod \"migrator-b985f5d89-mkz9w\" (UID: \"32973a7d-9edc-42d0-9a71-5c652ace1001\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" May 20 17:05:26.155244 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:26.155173 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/1.log" May 20 17:05:26.155648 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:26.155520 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" May 20 17:05:26.155648 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:26.155584 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/0.log" May 20 17:05:26.155648 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:26.155615 2563 generic.go:358] "Generic (PLEG): container finished" podID="d65c6ed2-d28c-4dab-b193-fe8e9088861c" containerID="4c2078ec4d06a839bfc0df69db5057e9b645149cd419eb669088726ad4941557" exitCode=255 May 20 17:05:26.155806 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:26.155735 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" event={"ID":"d65c6ed2-d28c-4dab-b193-fe8e9088861c","Type":"ContainerDied","Data":"4c2078ec4d06a839bfc0df69db5057e9b645149cd419eb669088726ad4941557"} May 20 17:05:26.155806 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:26.155780 2563 scope.go:117] "RemoveContainer" containerID="cd925548d24ebc75c9e9fcde1db425697c29fb7c410426cfbceaf33bbf612f47" May 20 17:05:26.156023 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:26.156007 2563 scope.go:117] "RemoveContainer" containerID="4c2078ec4d06a839bfc0df69db5057e9b645149cd419eb669088726ad4941557" May 20 17:05:26.156239 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:26.156217 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-bkxs2_openshift-console-operator(d65c6ed2-d28c-4dab-b193-fe8e9088861c)\"" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" podUID="d65c6ed2-d28c-4dab-b193-fe8e9088861c" May 20 17:05:26.280221 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:26.280038 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w"] May 20 17:05:26.282478 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:26.282442 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32973a7d_9edc_42d0_9a71_5c652ace1001.slice/crio-3564d32c4faea657c5e2923b6c11d709dca49191cec8e4ab90a2f2d13fce0ae8 WatchSource:0}: Error finding container 3564d32c4faea657c5e2923b6c11d709dca49191cec8e4ab90a2f2d13fce0ae8: Status 404 returned error can't find the container with id 3564d32c4faea657c5e2923b6c11d709dca49191cec8e4ab90a2f2d13fce0ae8 May 20 17:05:27.160419 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:27.160380 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/1.log" May 20 17:05:27.160906 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:27.160861 2563 scope.go:117] "RemoveContainer" containerID="4c2078ec4d06a839bfc0df69db5057e9b645149cd419eb669088726ad4941557" May 20 17:05:27.161127 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:27.161098 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-bkxs2_openshift-console-operator(d65c6ed2-d28c-4dab-b193-fe8e9088861c)\"" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" podUID="d65c6ed2-d28c-4dab-b193-fe8e9088861c" May 20 17:05:27.161685 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:27.161659 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" event={"ID":"32973a7d-9edc-42d0-9a71-5c652ace1001","Type":"ContainerStarted","Data":"3564d32c4faea657c5e2923b6c11d709dca49191cec8e4ab90a2f2d13fce0ae8"} May 20 17:05:27.504243 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:27.504131 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:27.504435 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:27.504297 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 17:05:27.504435 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:27.504392 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls podName:bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e nodeName:}" failed. No retries permitted until 2026-05-20 17:05:35.504371851 +0000 UTC m=+97.277395214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t2h2q" (UID: "bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e") : secret "cluster-monitoring-operator-tls" not found May 20 17:05:27.564445 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:27.564417 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4prt_2ac8bbc9-e535-4830-9fc3-afa16269a6f0/dns-node-resolver/0.log" May 20 17:05:27.605047 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:27.605004 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:27.605236 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:27.605179 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 17:05:27.605301 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:27.605259 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls podName:b2f515aa-3050-4ec9-851a-0a51c74535d3 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:35.605237105 +0000 UTC m=+97.378260468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls") pod "cluster-samples-operator-697587599-q5t65" (UID: "b2f515aa-3050-4ec9-851a-0a51c74535d3") : secret "samples-operator-tls" not found May 20 17:05:28.165375 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:28.165338 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" event={"ID":"32973a7d-9edc-42d0-9a71-5c652ace1001","Type":"ContainerStarted","Data":"0bfb1904d5957f5b899730f8dcb9383f769af0578f51449ceb2eec70d77094bd"} May 20 17:05:28.165375 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:28.165378 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" event={"ID":"32973a7d-9edc-42d0-9a71-5c652ace1001","Type":"ContainerStarted","Data":"21835d6bd1ff22e10a30bd9a31486906169b632d574b6d4a451a7ad431461d33"} May 20 17:05:28.183354 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:28.183303 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-mkz9w" podStartSLOduration=1.826432945 podStartE2EDuration="3.183288147s" podCreationTimestamp="2026-05-20 17:05:25 +0000 UTC" firstStartedPulling="2026-05-20 17:05:26.28454677 +0000 UTC m=+88.057570136" lastFinishedPulling="2026-05-20 17:05:27.641401973 +0000 UTC m=+89.414425338" observedRunningTime="2026-05-20 17:05:28.182537813 +0000 UTC m=+89.955561198" watchObservedRunningTime="2026-05-20 17:05:28.183288147 +0000 UTC m=+89.956311532" May 20 17:05:28.962636 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:28.962605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wm24m_231e130d-9265-45f0-82fd-7306d6440b07/node-ca/0.log" May 20 17:05:30.160418 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:30.160379 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:30.160418 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:30.160419 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:30.160840 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:30.160787 2563 scope.go:117] "RemoveContainer" containerID="4c2078ec4d06a839bfc0df69db5057e9b645149cd419eb669088726ad4941557" May 20 17:05:30.161008 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:30.160990 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-bkxs2_openshift-console-operator(d65c6ed2-d28c-4dab-b193-fe8e9088861c)\"" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" podUID="d65c6ed2-d28c-4dab-b193-fe8e9088861c" May 20 17:05:35.570615 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:35.570575 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:35.571034 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:35.570773 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 17:05:35.571034 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:35.570860 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls podName:bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e nodeName:}" failed. No retries permitted until 2026-05-20 17:05:51.57083654 +0000 UTC m=+113.343859921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t2h2q" (UID: "bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e") : secret "cluster-monitoring-operator-tls" not found May 20 17:05:35.671337 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:35.671301 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:35.674022 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:35.673995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2f515aa-3050-4ec9-851a-0a51c74535d3-samples-operator-tls\") pod \"cluster-samples-operator-697587599-q5t65\" (UID: \"b2f515aa-3050-4ec9-851a-0a51c74535d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:35.745552 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:35.745509 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" May 20 17:05:35.868070 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:35.868036 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65"] May 20 17:05:36.188275 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:36.188242 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" event={"ID":"b2f515aa-3050-4ec9-851a-0a51c74535d3","Type":"ContainerStarted","Data":"a63ad6aad78eb3507a76fc504de07f0267107fdece2c0484ccb3709fab50a6d7"} May 20 17:05:37.083017 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.082973 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:05:37.083467 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.083051 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:05:37.085771 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.085737 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a259a15-bf9c-4bd2-87fb-08aa32422e37-metrics-tls\") pod \"dns-default-4vxws\" (UID: \"9a259a15-bf9c-4bd2-87fb-08aa32422e37\") " pod="openshift-dns/dns-default-4vxws" May 20 17:05:37.085982 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.085960 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91924491-1822-4ff1-8759-17da34aeffb6-cert\") pod \"ingress-canary-5jtr8\" (UID: \"91924491-1822-4ff1-8759-17da34aeffb6\") " pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:05:37.353682 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.353646 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qmxjm\"" May 20 17:05:37.361651 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.361609 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4vxws" May 20 17:05:37.368702 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.368679 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4kg2\"" May 20 17:05:37.376554 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.376517 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jtr8" May 20 17:05:37.521437 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.521403 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4vxws"] May 20 17:05:37.524835 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:37.524802 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a259a15_bf9c_4bd2_87fb_08aa32422e37.slice/crio-14b2f2ae699615427f767e9e3b25fdbd56ca27ed0d4177f87faff5ff511af0ee WatchSource:0}: Error finding container 14b2f2ae699615427f767e9e3b25fdbd56ca27ed0d4177f87faff5ff511af0ee: Status 404 returned error can't find the container with id 14b2f2ae699615427f767e9e3b25fdbd56ca27ed0d4177f87faff5ff511af0ee May 20 17:05:37.541574 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:37.541539 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jtr8"] May 20 17:05:37.544531 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:37.544499 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91924491_1822_4ff1_8759_17da34aeffb6.slice/crio-f5e54ad4692364b0b747c47efb58e5ed9acd44c1481a154018ffebddd257e211 WatchSource:0}: Error finding container f5e54ad4692364b0b747c47efb58e5ed9acd44c1481a154018ffebddd257e211: Status 404 returned error can't find the container with id f5e54ad4692364b0b747c47efb58e5ed9acd44c1481a154018ffebddd257e211 May 20 17:05:38.200456 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:38.200419 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" event={"ID":"b2f515aa-3050-4ec9-851a-0a51c74535d3","Type":"ContainerStarted","Data":"f8104c6ccafc8e08efdf79d017fa702ca32be9fdb2eeb58193f55e8cc1da9cc8"} May 20 17:05:38.200910 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:38.200463 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" event={"ID":"b2f515aa-3050-4ec9-851a-0a51c74535d3","Type":"ContainerStarted","Data":"e75d7693da126fbafa84e736d823bdd2be624c5a4636825c650f2511dc43c315"} May 20 17:05:38.202300 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:38.202273 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jtr8" event={"ID":"91924491-1822-4ff1-8759-17da34aeffb6","Type":"ContainerStarted","Data":"f5e54ad4692364b0b747c47efb58e5ed9acd44c1481a154018ffebddd257e211"} May 20 17:05:38.205168 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:38.205142 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxws" event={"ID":"9a259a15-bf9c-4bd2-87fb-08aa32422e37","Type":"ContainerStarted","Data":"14b2f2ae699615427f767e9e3b25fdbd56ca27ed0d4177f87faff5ff511af0ee"} May 20 17:05:38.222689 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:38.222624 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-q5t65" podStartSLOduration=17.130784686 podStartE2EDuration="19.222605329s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="2026-05-20 17:05:35.916196353 +0000 UTC m=+97.689219716" lastFinishedPulling="2026-05-20 17:05:38.008016995 +0000 UTC m=+99.781040359" observedRunningTime="2026-05-20 17:05:38.22171268 +0000 UTC m=+99.994736065" watchObservedRunningTime="2026-05-20 17:05:38.222605329 +0000 UTC m=+99.995628716" May 20 17:05:39.103571 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:39.103539 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2knvn" May 20 17:05:40.211729 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:40.211687 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxws" event={"ID":"9a259a15-bf9c-4bd2-87fb-08aa32422e37","Type":"ContainerStarted","Data":"ef1f9521fbcdfc47dede6763c8c940142e0431dfbf7a6d5bea4dee9d415ccdd7"} May 20 17:05:40.211729 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:40.211728 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxws" event={"ID":"9a259a15-bf9c-4bd2-87fb-08aa32422e37","Type":"ContainerStarted","Data":"2bb04fafb2e11b849528fa95edaa6752d23cef6233fcdb52fa0bc053a57da9b4"} May 20 17:05:40.212251 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:40.211840 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4vxws" May 20 17:05:40.212976 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:40.212958 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jtr8" event={"ID":"91924491-1822-4ff1-8759-17da34aeffb6","Type":"ContainerStarted","Data":"251bf53585e46fed3dbcb6dba806c2fad5ccb6610afa7164c59d656905d77882"} May 20 17:05:40.229570 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:40.229522 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4vxws" podStartSLOduration=65.228834996 podStartE2EDuration="1m7.22950678s" podCreationTimestamp="2026-05-20 17:04:33 +0000 UTC" firstStartedPulling="2026-05-20 17:05:37.526687276 +0000 UTC m=+99.299710639" lastFinishedPulling="2026-05-20 17:05:39.527359058 +0000 UTC m=+101.300382423" observedRunningTime="2026-05-20 17:05:40.228532053 +0000 UTC m=+102.001555438" watchObservedRunningTime="2026-05-20 17:05:40.22950678 +0000 UTC m=+102.002530169" May 20 17:05:40.244689 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:40.244643 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5jtr8" podStartSLOduration=65.261183074 podStartE2EDuration="1m7.244625506s" podCreationTimestamp="2026-05-20 17:04:33 +0000 UTC" firstStartedPulling="2026-05-20 17:05:37.546521658 +0000 UTC m=+99.319545021" lastFinishedPulling="2026-05-20 17:05:39.52996409 +0000 UTC m=+101.302987453" observedRunningTime="2026-05-20 17:05:40.244570992 +0000 UTC m=+102.017594377" watchObservedRunningTime="2026-05-20 17:05:40.244625506 +0000 UTC m=+102.017648893" May 20 17:05:40.868496 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:40.868458 2563 scope.go:117] "RemoveContainer" containerID="4c2078ec4d06a839bfc0df69db5057e9b645149cd419eb669088726ad4941557" May 20 17:05:41.217370 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:41.217285 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:05:41.217769 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:41.217688 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/1.log" May 20 17:05:41.217769 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:41.217726 2563 generic.go:358] "Generic (PLEG): container finished" podID="d65c6ed2-d28c-4dab-b193-fe8e9088861c" containerID="6e81700919ab67148cd71d32be54923d63a98f7da4e06ddafd9478a95477a8c8" exitCode=255 May 20 17:05:41.217898 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:41.217805 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" event={"ID":"d65c6ed2-d28c-4dab-b193-fe8e9088861c","Type":"ContainerDied","Data":"6e81700919ab67148cd71d32be54923d63a98f7da4e06ddafd9478a95477a8c8"} May 20 17:05:41.217898 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:41.217847 2563 scope.go:117] "RemoveContainer" containerID="4c2078ec4d06a839bfc0df69db5057e9b645149cd419eb669088726ad4941557" May 20 17:05:41.218364 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:41.218338 2563 scope.go:117] "RemoveContainer" containerID="6e81700919ab67148cd71d32be54923d63a98f7da4e06ddafd9478a95477a8c8" May 20 17:05:41.218556 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:41.218530 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-bkxs2_openshift-console-operator(d65c6ed2-d28c-4dab-b193-fe8e9088861c)\"" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" podUID="d65c6ed2-d28c-4dab-b193-fe8e9088861c" May 20 17:05:42.221833 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:42.221804 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:05:49.388283 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.388253 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dnfdb"] May 20 17:05:49.391052 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.391033 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.394604 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.394582 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmjr5\"" May 20 17:05:49.395397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.395371 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 17:05:49.395823 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.395807 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 17:05:49.408534 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.408500 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dnfdb"] May 20 17:05:49.487141 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.487104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-data-volume\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.487141 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.487139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.487403 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.487164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.487403 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.487324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gxk\" (UniqueName: \"kubernetes.io/projected/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-kube-api-access-26gxk\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.487403 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.487391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-crio-socket\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.588936 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.588864 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-data-volume\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.588936 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.588935 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.589277 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.588965 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.589277 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.589119 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26gxk\" (UniqueName: \"kubernetes.io/projected/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-kube-api-access-26gxk\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.589277 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.589183 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-crio-socket\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.589277 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.589274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-data-volume\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.589568 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.589294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-crio-socket\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.589568 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.589498 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.591931 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.591909 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.602466 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.602442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gxk\" (UniqueName: \"kubernetes.io/projected/c30dd71b-6990-44c7-bbf7-37ae0763c8bc-kube-api-access-26gxk\") pod \"insights-runtime-extractor-dnfdb\" (UID: \"c30dd71b-6990-44c7-bbf7-37ae0763c8bc\") " pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.700422 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.700307 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dnfdb" May 20 17:05:49.824529 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:49.824496 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dnfdb"] May 20 17:05:49.830077 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:49.830047 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30dd71b_6990_44c7_bbf7_37ae0763c8bc.slice/crio-5c7cdbe46556d6c72a01a7cbf98453d45f7ed9d9519cdda4d8517217b2737d65 WatchSource:0}: Error finding container 5c7cdbe46556d6c72a01a7cbf98453d45f7ed9d9519cdda4d8517217b2737d65: Status 404 returned error can't find the container with id 5c7cdbe46556d6c72a01a7cbf98453d45f7ed9d9519cdda4d8517217b2737d65 May 20 17:05:50.160791 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:50.160758 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:50.160791 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:50.160795 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:05:50.161236 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:50.161220 2563 scope.go:117] "RemoveContainer" containerID="6e81700919ab67148cd71d32be54923d63a98f7da4e06ddafd9478a95477a8c8" May 20 17:05:50.161434 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:50.161414 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-bkxs2_openshift-console-operator(d65c6ed2-d28c-4dab-b193-fe8e9088861c)\"" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" podUID="d65c6ed2-d28c-4dab-b193-fe8e9088861c" May 20 17:05:50.220488 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:50.220444 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4vxws" May 20 17:05:50.241240 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:50.241209 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnfdb" event={"ID":"c30dd71b-6990-44c7-bbf7-37ae0763c8bc","Type":"ContainerStarted","Data":"48cc5e2143b80ba7bc0220ba6c4ef988f4f3cca19b1d8a2a3de318bc55132636"} May 20 17:05:50.241240 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:50.241240 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnfdb" event={"ID":"c30dd71b-6990-44c7-bbf7-37ae0763c8bc","Type":"ContainerStarted","Data":"5c7cdbe46556d6c72a01a7cbf98453d45f7ed9d9519cdda4d8517217b2737d65"} May 20 17:05:51.245891 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:51.245785 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnfdb" event={"ID":"c30dd71b-6990-44c7-bbf7-37ae0763c8bc","Type":"ContainerStarted","Data":"bf49363d5e98b6ead362d97c54455afc3fabe3bec448f685134e90b09559e4e2"} May 20 17:05:51.605063 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:51.605020 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:51.607783 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:51.607756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t2h2q\" (UID: \"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:51.834026 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:51.833981 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" May 20 17:05:52.250832 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:52.250796 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnfdb" event={"ID":"c30dd71b-6990-44c7-bbf7-37ae0763c8bc","Type":"ContainerStarted","Data":"5aeb71d691df42ecab44a3384d99a3b4116a39d134472007eaf752d01f5b2a93"} May 20 17:05:52.258452 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:52.258426 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q"] May 20 17:05:52.261135 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:52.261110 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc151c4_d9f2_47da_b3c1_56e2cca5cb3e.slice/crio-7bfc5f7ff614b575fdc29e08a774b3ecc58215ce34eeab2cebef6bf978e063ac WatchSource:0}: Error finding container 7bfc5f7ff614b575fdc29e08a774b3ecc58215ce34eeab2cebef6bf978e063ac: Status 404 returned error can't find the container with id 7bfc5f7ff614b575fdc29e08a774b3ecc58215ce34eeab2cebef6bf978e063ac May 20 17:05:52.271863 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:52.271818 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dnfdb" podStartSLOduration=0.999982913 podStartE2EDuration="3.271803318s" podCreationTimestamp="2026-05-20 17:05:49 +0000 UTC" firstStartedPulling="2026-05-20 17:05:49.89189819 +0000 UTC m=+111.664921563" lastFinishedPulling="2026-05-20 17:05:52.163718585 +0000 UTC m=+113.936741968" observedRunningTime="2026-05-20 17:05:52.270926585 +0000 UTC m=+114.043949971" watchObservedRunningTime="2026-05-20 17:05:52.271803318 +0000 UTC m=+114.044826702" May 20 17:05:53.254940 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:53.254897 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" event={"ID":"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e","Type":"ContainerStarted","Data":"7bfc5f7ff614b575fdc29e08a774b3ecc58215ce34eeab2cebef6bf978e063ac"} May 20 17:05:54.725487 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:54.725452 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q"] May 20 17:05:54.727629 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:54.727603 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" May 20 17:05:54.730118 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:54.730098 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 20 17:05:54.730249 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:54.730141 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r2jrl\"" May 20 17:05:54.730249 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:54.730183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-l578q\" (UID: \"22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" May 20 17:05:54.735425 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:54.735404 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q"] May 20 17:05:54.830710 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:54.830673 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-l578q\" (UID: \"22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" May 20 17:05:54.830908 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:54.830818 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 20 17:05:54.830969 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:54.830914 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1-tls-certificates podName:22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:55.330893705 +0000 UTC m=+117.103917068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-l578q" (UID: "22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1") : secret "prometheus-operator-admission-webhook-tls" not found May 20 17:05:55.261321 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:55.261278 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" event={"ID":"bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e","Type":"ContainerStarted","Data":"7783353e7609d83577b69b9778e29d4079a0080e5e05686a34bdd05d740a3870"} May 20 17:05:55.277415 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:55.277364 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t2h2q" podStartSLOduration=34.309144976 podStartE2EDuration="36.277349773s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="2026-05-20 17:05:52.263320071 +0000 UTC m=+114.036343433" lastFinishedPulling="2026-05-20 17:05:54.231524868 +0000 UTC m=+116.004548230" observedRunningTime="2026-05-20 17:05:55.276192455 +0000 UTC m=+117.049215840" watchObservedRunningTime="2026-05-20 17:05:55.277349773 +0000 UTC m=+117.050373155" May 20 17:05:55.333964 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:55.333917 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-l578q\" (UID: \"22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" May 20 17:05:55.336695 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:55.336671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-l578q\" (UID: \"22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" May 20 17:05:55.336795 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:55.336785 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" May 20 17:05:55.464517 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:55.464480 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q"] May 20 17:05:55.467600 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:55.467569 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ac31c7_4ded_4c4c_8d24_2d0dbc8695c1.slice/crio-75269d817a6cbd5c661f2e91b3ecf53d33abb42876d15d9043e156360e8cff04 WatchSource:0}: Error finding container 75269d817a6cbd5c661f2e91b3ecf53d33abb42876d15d9043e156360e8cff04: Status 404 returned error can't find the container with id 75269d817a6cbd5c661f2e91b3ecf53d33abb42876d15d9043e156360e8cff04 May 20 17:05:56.265116 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:56.265076 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" event={"ID":"22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1","Type":"ContainerStarted","Data":"75269d817a6cbd5c661f2e91b3ecf53d33abb42876d15d9043e156360e8cff04"} May 20 17:05:57.269447 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.269361 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" event={"ID":"22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1","Type":"ContainerStarted","Data":"2824eea9739e125a289c18d2738f7069f07c69c3d483562974599a897ef7f41f"} May 20 17:05:57.269913 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.269555 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" May 20 17:05:57.275090 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.275062 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" May 20 17:05:57.284793 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.284740 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-l578q" podStartSLOduration=1.899121814 podStartE2EDuration="3.284699196s" podCreationTimestamp="2026-05-20 17:05:54 +0000 UTC" firstStartedPulling="2026-05-20 17:05:55.469574946 +0000 UTC m=+117.242598309" lastFinishedPulling="2026-05-20 17:05:56.855152312 +0000 UTC m=+118.628175691" observedRunningTime="2026-05-20 17:05:57.284212689 +0000 UTC m=+119.057236074" watchObservedRunningTime="2026-05-20 17:05:57.284699196 +0000 UTC m=+119.057722622" May 20 17:05:57.785665 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.785632 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr"] May 20 17:05:57.787797 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.787780 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.791386 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.791359 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 20 17:05:57.791517 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.791494 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 20 17:05:57.791517 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.791504 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wmz7z\"" May 20 17:05:57.791638 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.791550 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 17:05:57.801357 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.801303 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr"] May 20 17:05:57.850688 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.850646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwtq9\" (UniqueName: \"kubernetes.io/projected/9bb75ed1-2ff6-4008-bc60-5f28d329f686-kube-api-access-vwtq9\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.850900 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.850694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.850900 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.850790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.850900 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.850814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb75ed1-2ff6-4008-bc60-5f28d329f686-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.951208 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.951168 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.951365 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.951259 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.951365 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.951286 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb75ed1-2ff6-4008-bc60-5f28d329f686-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.951365 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.951341 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwtq9\" (UniqueName: \"kubernetes.io/projected/9bb75ed1-2ff6-4008-bc60-5f28d329f686-kube-api-access-vwtq9\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.951480 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:57.951403 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 20 17:05:57.951518 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:05:57.951484 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-tls podName:9bb75ed1-2ff6-4008-bc60-5f28d329f686 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:58.451467291 +0000 UTC m=+120.224490665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-dfxpr" (UID: "9bb75ed1-2ff6-4008-bc60-5f28d329f686") : secret "prometheus-operator-tls" not found May 20 17:05:57.951957 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.951934 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb75ed1-2ff6-4008-bc60-5f28d329f686-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.954454 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.954427 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:57.960470 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:57.960438 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwtq9\" (UniqueName: \"kubernetes.io/projected/9bb75ed1-2ff6-4008-bc60-5f28d329f686-kube-api-access-vwtq9\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:58.455237 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:58.455191 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:58.458561 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:58.458516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bb75ed1-2ff6-4008-bc60-5f28d329f686-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dfxpr\" (UID: \"9bb75ed1-2ff6-4008-bc60-5f28d329f686\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:58.697199 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:58.697149 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" May 20 17:05:58.830393 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:58.830360 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr"] May 20 17:05:58.833719 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:05:58.833697 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb75ed1_2ff6_4008_bc60_5f28d329f686.slice/crio-b77a06a92bf73090a0f1d5fbfb51003164f03b9eca776317f584577f9f9763cd WatchSource:0}: Error finding container b77a06a92bf73090a0f1d5fbfb51003164f03b9eca776317f584577f9f9763cd: Status 404 returned error can't find the container with id b77a06a92bf73090a0f1d5fbfb51003164f03b9eca776317f584577f9f9763cd May 20 17:05:59.275649 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:05:59.275605 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" event={"ID":"9bb75ed1-2ff6-4008-bc60-5f28d329f686","Type":"ContainerStarted","Data":"b77a06a92bf73090a0f1d5fbfb51003164f03b9eca776317f584577f9f9763cd"} May 20 17:06:00.280248 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:00.280218 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" event={"ID":"9bb75ed1-2ff6-4008-bc60-5f28d329f686","Type":"ContainerStarted","Data":"d0076ff500cac5f0ab566f84e9e2dfb5ab4c12123738501eb96a70b1e3c6e883"} May 20 17:06:01.284466 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:01.284429 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" event={"ID":"9bb75ed1-2ff6-4008-bc60-5f28d329f686","Type":"ContainerStarted","Data":"935fbd0f1293051a1583aa610dc0f3a74033de323d52e0f5d9ea8793c33c9497"} May 20 17:06:01.300316 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:01.300260 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dfxpr" podStartSLOduration=2.950814608 podStartE2EDuration="4.300245826s" podCreationTimestamp="2026-05-20 17:05:57 +0000 UTC" firstStartedPulling="2026-05-20 17:05:58.835477451 +0000 UTC m=+120.608500815" lastFinishedPulling="2026-05-20 17:06:00.184908652 +0000 UTC m=+121.957932033" observedRunningTime="2026-05-20 17:06:01.299355818 +0000 UTC m=+123.072379225" watchObservedRunningTime="2026-05-20 17:06:01.300245826 +0000 UTC m=+123.073269210" May 20 17:06:02.868686 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:02.868654 2563 scope.go:117] "RemoveContainer" containerID="6e81700919ab67148cd71d32be54923d63a98f7da4e06ddafd9478a95477a8c8" May 20 17:06:03.143051 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.142957 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hc6gs"] May 20 17:06:03.145311 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.145288 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.147701 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.147668 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 17:06:03.147701 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.147684 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 17:06:03.147701 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.147700 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 17:06:03.147943 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.147710 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9wj78\"" May 20 17:06:03.194693 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.194655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-accelerators-collector-config\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.194890 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.194715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-tls\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.194890 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.194808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7c23f04-987a-4bff-ae86-32303f4e8151-metrics-client-ca\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.194890 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.194840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-sys\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.194890 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.194861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.195066 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.194920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-wtmp\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.195066 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.194935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg2rn\" (UniqueName: \"kubernetes.io/projected/a7c23f04-987a-4bff-ae86-32303f4e8151-kube-api-access-zg2rn\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.195066 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.194961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-root\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.195066 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.195035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-textfile\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.292277 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.292251 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:06:03.292448 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.292315 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" event={"ID":"d65c6ed2-d28c-4dab-b193-fe8e9088861c","Type":"ContainerStarted","Data":"9b2bd29a3a3d315bbd94241e35cd4a26fa212cad892dbf11d10bcec87fe96016"} May 20 17:06:03.292617 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.292590 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:06:03.295368 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295347 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7c23f04-987a-4bff-ae86-32303f4e8151-metrics-client-ca\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295496 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295375 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-sys\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295496 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295394 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295496 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295412 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-wtmp\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295496 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295429 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zg2rn\" (UniqueName: \"kubernetes.io/projected/a7c23f04-987a-4bff-ae86-32303f4e8151-kube-api-access-zg2rn\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295692 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295503 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-sys\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295692 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295561 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-root\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295692 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295593 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-root\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295692 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295631 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-textfile\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295692 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295658 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-accelerators-collector-config\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.295692 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295561 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-wtmp\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.296006 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295715 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-tls\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.296006 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.295996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-textfile\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.296102 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.296055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7c23f04-987a-4bff-ae86-32303f4e8151-metrics-client-ca\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.296316 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.296211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-accelerators-collector-config\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.298022 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.297992 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.298125 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.298109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7c23f04-987a-4bff-ae86-32303f4e8151-node-exporter-tls\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.302568 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.302533 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg2rn\" (UniqueName: \"kubernetes.io/projected/a7c23f04-987a-4bff-ae86-32303f4e8151-kube-api-access-zg2rn\") pod \"node-exporter-hc6gs\" (UID: \"a7c23f04-987a-4bff-ae86-32303f4e8151\") " pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.308471 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.308427 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" podStartSLOduration=40.446461254 podStartE2EDuration="44.308413301s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="2026-05-20 17:05:20.331703352 +0000 UTC m=+82.104726728" lastFinishedPulling="2026-05-20 17:05:24.193655405 +0000 UTC m=+85.966678775" observedRunningTime="2026-05-20 17:06:03.308302192 +0000 UTC m=+125.081325578" watchObservedRunningTime="2026-05-20 17:06:03.308413301 +0000 UTC m=+125.081436689" May 20 17:06:03.455121 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.455031 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hc6gs" May 20 17:06:03.463797 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:06:03.463768 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c23f04_987a_4bff_ae86_32303f4e8151.slice/crio-574787297a806fc91399afd0bcf7455b6336c0af90d46e79810b55eb8e2a9c0e WatchSource:0}: Error finding container 574787297a806fc91399afd0bcf7455b6336c0af90d46e79810b55eb8e2a9c0e: Status 404 returned error can't find the container with id 574787297a806fc91399afd0bcf7455b6336c0af90d46e79810b55eb8e2a9c0e May 20 17:06:03.787632 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.787549 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-bkxs2" May 20 17:06:03.972551 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.972511 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-n4248"] May 20 17:06:03.974945 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.974924 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-n4248" May 20 17:06:03.977809 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.977511 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-krm6q\"" May 20 17:06:03.977809 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.977645 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 20 17:06:03.977809 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.977796 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 20 17:06:03.984387 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:03.984030 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-n4248"] May 20 17:06:04.002125 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:04.002081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nx9j\" (UniqueName: \"kubernetes.io/projected/ccdfcfa3-dd86-4767-af21-02a2209c8d6e-kube-api-access-9nx9j\") pod \"downloads-57bd96b888-n4248\" (UID: \"ccdfcfa3-dd86-4767-af21-02a2209c8d6e\") " pod="openshift-console/downloads-57bd96b888-n4248" May 20 17:06:04.102951 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:04.102715 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx9j\" (UniqueName: \"kubernetes.io/projected/ccdfcfa3-dd86-4767-af21-02a2209c8d6e-kube-api-access-9nx9j\") pod \"downloads-57bd96b888-n4248\" (UID: \"ccdfcfa3-dd86-4767-af21-02a2209c8d6e\") " pod="openshift-console/downloads-57bd96b888-n4248" May 20 17:06:04.114236 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:04.114202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nx9j\" (UniqueName: \"kubernetes.io/projected/ccdfcfa3-dd86-4767-af21-02a2209c8d6e-kube-api-access-9nx9j\") pod \"downloads-57bd96b888-n4248\" (UID: \"ccdfcfa3-dd86-4767-af21-02a2209c8d6e\") " pod="openshift-console/downloads-57bd96b888-n4248" May 20 17:06:04.287761 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:04.287723 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-n4248" May 20 17:06:04.296216 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:04.296175 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6gs" event={"ID":"a7c23f04-987a-4bff-ae86-32303f4e8151","Type":"ContainerStarted","Data":"574787297a806fc91399afd0bcf7455b6336c0af90d46e79810b55eb8e2a9c0e"} May 20 17:06:04.485855 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:04.485788 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-n4248"] May 20 17:06:04.490471 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:06:04.490434 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdfcfa3_dd86_4767_af21_02a2209c8d6e.slice/crio-39d73de8d62a5037d1e77cbbb3f4dc305b98ac114f317e33aaafc781ee364fcb WatchSource:0}: Error finding container 39d73de8d62a5037d1e77cbbb3f4dc305b98ac114f317e33aaafc781ee364fcb: Status 404 returned error can't find the container with id 39d73de8d62a5037d1e77cbbb3f4dc305b98ac114f317e33aaafc781ee364fcb May 20 17:06:05.301466 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:05.301423 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-n4248" event={"ID":"ccdfcfa3-dd86-4767-af21-02a2209c8d6e","Type":"ContainerStarted","Data":"39d73de8d62a5037d1e77cbbb3f4dc305b98ac114f317e33aaafc781ee364fcb"} May 20 17:06:05.303197 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:05.303163 2563 generic.go:358] "Generic (PLEG): container finished" podID="a7c23f04-987a-4bff-ae86-32303f4e8151" containerID="2432126c25c1eba6ddf7141a41e093eab7f30e138493c2ce4a977badbe367054" exitCode=0 May 20 17:06:05.303324 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:05.303253 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6gs" event={"ID":"a7c23f04-987a-4bff-ae86-32303f4e8151","Type":"ContainerDied","Data":"2432126c25c1eba6ddf7141a41e093eab7f30e138493c2ce4a977badbe367054"} May 20 17:06:06.308744 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:06.308705 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6gs" event={"ID":"a7c23f04-987a-4bff-ae86-32303f4e8151","Type":"ContainerStarted","Data":"21f656aa88fd9fe8ce28a6a8b58e142906e37937bb126e8d3c2e4d6df5827f0b"} May 20 17:06:06.309221 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:06.308751 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6gs" event={"ID":"a7c23f04-987a-4bff-ae86-32303f4e8151","Type":"ContainerStarted","Data":"1c78cfec03c6527a75d7238a559b6ab3e9375c680a9f7a365dd049117f6c127a"} May 20 17:06:06.330833 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:06.330778 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hc6gs" podStartSLOduration=2.417324973 podStartE2EDuration="3.330764305s" podCreationTimestamp="2026-05-20 17:06:03 +0000 UTC" firstStartedPulling="2026-05-20 17:06:03.465705705 +0000 UTC m=+125.238729070" lastFinishedPulling="2026-05-20 17:06:04.379145036 +0000 UTC m=+126.152168402" observedRunningTime="2026-05-20 17:06:06.328813384 +0000 UTC m=+128.101836771" watchObservedRunningTime="2026-05-20 17:06:06.330764305 +0000 UTC m=+128.103787690" May 20 17:06:07.904302 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:07.904269 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp"] May 20 17:06:07.907112 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:07.907089 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" May 20 17:06:07.909661 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:07.909637 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 20 17:06:07.909661 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:07.909652 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-ghvgs\"" May 20 17:06:07.914367 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:07.914339 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp"] May 20 17:06:07.941061 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:07.941032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fa85426-9a91-4d52-9b2c-796cc1c24941-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-nwxdp\" (UID: \"1fa85426-9a91-4d52-9b2c-796cc1c24941\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" May 20 17:06:08.042379 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.042344 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fa85426-9a91-4d52-9b2c-796cc1c24941-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-nwxdp\" (UID: \"1fa85426-9a91-4d52-9b2c-796cc1c24941\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" May 20 17:06:08.042552 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:06:08.042496 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 20 17:06:08.042620 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:06:08.042609 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fa85426-9a91-4d52-9b2c-796cc1c24941-monitoring-plugin-cert podName:1fa85426-9a91-4d52-9b2c-796cc1c24941 nodeName:}" failed. No retries permitted until 2026-05-20 17:06:08.542551934 +0000 UTC m=+130.315575305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1fa85426-9a91-4d52-9b2c-796cc1c24941-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-nwxdp" (UID: "1fa85426-9a91-4d52-9b2c-796cc1c24941") : secret "monitoring-plugin-cert" not found May 20 17:06:08.546605 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.546552 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:06:08.546802 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.546656 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fa85426-9a91-4d52-9b2c-796cc1c24941-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-nwxdp\" (UID: \"1fa85426-9a91-4d52-9b2c-796cc1c24941\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" May 20 17:06:08.549406 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.549380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b2eeb9-1b45-4073-a920-6e63f19c9384-metrics-certs\") pod \"network-metrics-daemon-gs5mr\" (UID: \"e6b2eeb9-1b45-4073-a920-6e63f19c9384\") " pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:06:08.549520 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.549428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fa85426-9a91-4d52-9b2c-796cc1c24941-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-nwxdp\" (UID: \"1fa85426-9a91-4d52-9b2c-796cc1c24941\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" May 20 17:06:08.689111 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.689075 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phplh\"" May 20 17:06:08.697170 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.697136 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gs5mr" May 20 17:06:08.820056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.819983 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" May 20 17:06:08.858038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.857985 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gs5mr"] May 20 17:06:08.990610 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:08.990409 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp"] May 20 17:06:08.993666 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:06:08.993639 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa85426_9a91_4d52_9b2c_796cc1c24941.slice/crio-36579307e9b9492a295962d22c2299c59c8003dde0edc3636e94b0e522de34cc WatchSource:0}: Error finding container 36579307e9b9492a295962d22c2299c59c8003dde0edc3636e94b0e522de34cc: Status 404 returned error can't find the container with id 36579307e9b9492a295962d22c2299c59c8003dde0edc3636e94b0e522de34cc May 20 17:06:09.318858 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.318743 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gs5mr" event={"ID":"e6b2eeb9-1b45-4073-a920-6e63f19c9384","Type":"ContainerStarted","Data":"f7dded98d77b443b90d6790bad71d844cead0cb5d25ce099dc5d359097fa70f5"} May 20 17:06:09.320206 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.320179 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" event={"ID":"1fa85426-9a91-4d52-9b2c-796cc1c24941","Type":"ContainerStarted","Data":"36579307e9b9492a295962d22c2299c59c8003dde0edc3636e94b0e522de34cc"} May 20 17:06:09.386801 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.386502 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:06:09.392775 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.392740 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.395378 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.395797 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.395930 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.396054 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.396102 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.396262 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hqrrr\"" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.396306 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.396448 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 17:06:09.396573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.396484 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 17:06:09.398188 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.397469 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 17:06:09.398188 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.397781 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 17:06:09.398415 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.398397 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-990s533ib8ck0\"" May 20 17:06:09.398645 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.398629 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 17:06:09.399285 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.399263 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 17:06:09.404099 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.404075 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 17:06:09.413260 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.411597 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:06:09.455850 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.455802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456059 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.455898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456059 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.455932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456059 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.455959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456059 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456265 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456112 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456265 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-config\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456265 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6xcz\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-kube-api-access-k6xcz\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456265 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456265 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.456830 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.456510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557221 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557276 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557306 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557332 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557355 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557398 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557431 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557460 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557486 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557516 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557551 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557583 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-config\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557619 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6xcz\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-kube-api-access-k6xcz\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557657 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557691 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557720 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.557970 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557750 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.558996 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.557787 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.559925 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.559300 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.561327 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.561298 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.562207 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.562105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.562380 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.562271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.562380 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.562346 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.562996 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.562970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.564371 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.564063 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.564371 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.564197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.567685 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.567057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.568947 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.568860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.569192 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.569172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.570731 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.570682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6xcz\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-kube-api-access-k6xcz\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.572617 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.572289 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.576309 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.576263 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-config\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.576942 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.576902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.577460 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.577422 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.578070 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.578031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.580444 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.580401 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.716180 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.715530 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:09.901953 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:09.901896 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:06:10.080924 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:06:10.080886 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a23c03_97cd_4374_8d2a_020b64f421ed.slice/crio-4b5b4d760f98415f553e752e74d2486b7ac932bf97695c9bde88494e69a2d169 WatchSource:0}: Error finding container 4b5b4d760f98415f553e752e74d2486b7ac932bf97695c9bde88494e69a2d169: Status 404 returned error can't find the container with id 4b5b4d760f98415f553e752e74d2486b7ac932bf97695c9bde88494e69a2d169 May 20 17:06:10.325486 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:10.325448 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gs5mr" event={"ID":"e6b2eeb9-1b45-4073-a920-6e63f19c9384","Type":"ContainerStarted","Data":"2cac95d26f6a6f854a915952459b224bfd1dac27f2e38986f5b94029d7a70102"} May 20 17:06:10.326705 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:10.326676 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerStarted","Data":"4b5b4d760f98415f553e752e74d2486b7ac932bf97695c9bde88494e69a2d169"} May 20 17:06:11.332436 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:11.332343 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gs5mr" event={"ID":"e6b2eeb9-1b45-4073-a920-6e63f19c9384","Type":"ContainerStarted","Data":"8b190ba476387512cfc6fec3439004974d01d5c7b39a85c27cbad5e1106f9952"} May 20 17:06:11.333747 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:11.333711 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" event={"ID":"1fa85426-9a91-4d52-9b2c-796cc1c24941","Type":"ContainerStarted","Data":"d8b9938238600fd39859eb614883f6f99c71f290bfe4990eef94f5b429009bd7"} May 20 17:06:11.334008 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:11.333976 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" May 20 17:06:11.339581 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:11.339557 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" May 20 17:06:11.349370 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:11.349312 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gs5mr" podStartSLOduration=131.101657275 podStartE2EDuration="2m12.349294234s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:06:08.861196594 +0000 UTC m=+130.634219972" lastFinishedPulling="2026-05-20 17:06:10.108833565 +0000 UTC m=+131.881856931" observedRunningTime="2026-05-20 17:06:11.347817588 +0000 UTC m=+133.120840973" watchObservedRunningTime="2026-05-20 17:06:11.349294234 +0000 UTC m=+133.122317622" May 20 17:06:11.363959 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:11.363903 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nwxdp" podStartSLOduration=2.457757489 podStartE2EDuration="4.363857449s" podCreationTimestamp="2026-05-20 17:06:07 +0000 UTC" firstStartedPulling="2026-05-20 17:06:08.996153023 +0000 UTC m=+130.769176386" lastFinishedPulling="2026-05-20 17:06:10.902252975 +0000 UTC m=+132.675276346" observedRunningTime="2026-05-20 17:06:11.362074234 +0000 UTC m=+133.135097621" watchObservedRunningTime="2026-05-20 17:06:11.363857449 +0000 UTC m=+133.136880834" May 20 17:06:12.338821 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:12.338730 2563 generic.go:358] "Generic (PLEG): container finished" podID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerID="8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07" exitCode=0 May 20 17:06:12.339275 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:12.338821 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerDied","Data":"8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07"} May 20 17:06:22.381007 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:22.380973 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerStarted","Data":"9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495"} May 20 17:06:23.396797 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:23.396722 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerStarted","Data":"82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730"} May 20 17:06:23.404162 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:23.403035 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-n4248" event={"ID":"ccdfcfa3-dd86-4767-af21-02a2209c8d6e","Type":"ContainerStarted","Data":"643505aca1f05a07c4b8dadfdf701a4275b0c02d0b443412dbd58f79da40c625"} May 20 17:06:23.404162 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:23.404116 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-n4248" May 20 17:06:23.419636 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:23.419414 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-n4248" May 20 17:06:23.425057 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:23.424998 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-n4248" podStartSLOduration=2.5966318 podStartE2EDuration="20.424983155s" podCreationTimestamp="2026-05-20 17:06:03 +0000 UTC" firstStartedPulling="2026-05-20 17:06:04.492765861 +0000 UTC m=+126.265789224" lastFinishedPulling="2026-05-20 17:06:22.321117212 +0000 UTC m=+144.094140579" observedRunningTime="2026-05-20 17:06:23.419331852 +0000 UTC m=+145.192355239" watchObservedRunningTime="2026-05-20 17:06:23.424983155 +0000 UTC m=+145.198006551" May 20 17:06:25.414422 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:25.414387 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerStarted","Data":"c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144"} May 20 17:06:25.414825 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:25.414427 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerStarted","Data":"a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141"} May 20 17:06:26.421559 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:26.421521 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerStarted","Data":"177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015"} May 20 17:06:26.422030 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:26.421566 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerStarted","Data":"0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920"} May 20 17:06:26.448192 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:26.448125 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.422976182 podStartE2EDuration="17.448104765s" podCreationTimestamp="2026-05-20 17:06:09 +0000 UTC" firstStartedPulling="2026-05-20 17:06:10.083360564 +0000 UTC m=+131.856383942" lastFinishedPulling="2026-05-20 17:06:25.108489145 +0000 UTC m=+146.881512525" observedRunningTime="2026-05-20 17:06:26.447045913 +0000 UTC m=+148.220069300" watchObservedRunningTime="2026-05-20 17:06:26.448104765 +0000 UTC m=+148.221128153" May 20 17:06:29.716713 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:29.716671 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:06:45.479426 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:45.479387 2563 generic.go:358] "Generic (PLEG): container finished" podID="7b07d22d-9ba8-473c-a06b-20232e88379e" containerID="1cf6452206a6eabc45a2f7e33e8ec145ca8fd5bf288e6c885c84adc4d76eb7d7" exitCode=0 May 20 17:06:45.479890 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:45.479449 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" event={"ID":"7b07d22d-9ba8-473c-a06b-20232e88379e","Type":"ContainerDied","Data":"1cf6452206a6eabc45a2f7e33e8ec145ca8fd5bf288e6c885c84adc4d76eb7d7"} May 20 17:06:45.479890 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:45.479814 2563 scope.go:117] "RemoveContainer" containerID="1cf6452206a6eabc45a2f7e33e8ec145ca8fd5bf288e6c885c84adc4d76eb7d7" May 20 17:06:46.483851 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:46.483819 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fcqrb" event={"ID":"7b07d22d-9ba8-473c-a06b-20232e88379e","Type":"ContainerStarted","Data":"fdb90b113f10a692b54e2a3af33fce3ce3e1813ea5a57cd696cd60d968b9f1ad"} May 20 17:06:55.510376 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:55.510338 2563 generic.go:358] "Generic (PLEG): container finished" podID="65b4a295-6e8b-4265-bad2-f30eb0fe88b5" containerID="06255a029cb5454244ef312d1d622f404a290fe948080ff35610e3ad36e86705" exitCode=0 May 20 17:06:55.510791 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:55.510409 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" event={"ID":"65b4a295-6e8b-4265-bad2-f30eb0fe88b5","Type":"ContainerDied","Data":"06255a029cb5454244ef312d1d622f404a290fe948080ff35610e3ad36e86705"} May 20 17:06:55.510791 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:55.510765 2563 scope.go:117] "RemoveContainer" containerID="06255a029cb5454244ef312d1d622f404a290fe948080ff35610e3ad36e86705" May 20 17:06:56.515087 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:06:56.515049 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpgqx" event={"ID":"65b4a295-6e8b-4265-bad2-f30eb0fe88b5","Type":"ContainerStarted","Data":"cf907121d72693618a85ec729f43179f70a121059a79ae6588689ea0c77707e0"} May 20 17:07:00.526774 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:00.526680 2563 generic.go:358] "Generic (PLEG): container finished" podID="fdaa5d89-3dfc-44ed-b29a-cc95026827d9" containerID="b6f360ea74fcc608b5f2ab4ef951ef491f3c2330163e4be23d1faf910f38600c" exitCode=0 May 20 17:07:00.526774 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:00.526725 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" event={"ID":"fdaa5d89-3dfc-44ed-b29a-cc95026827d9","Type":"ContainerDied","Data":"b6f360ea74fcc608b5f2ab4ef951ef491f3c2330163e4be23d1faf910f38600c"} May 20 17:07:00.527310 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:00.527163 2563 scope.go:117] "RemoveContainer" containerID="b6f360ea74fcc608b5f2ab4ef951ef491f3c2330163e4be23d1faf910f38600c" May 20 17:07:01.533778 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:01.533059 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-6sfd6" event={"ID":"fdaa5d89-3dfc-44ed-b29a-cc95026827d9","Type":"ContainerStarted","Data":"bbdec1a842a62ff24a4eacfc31c31aac99812e304a71fd8307b4cec5b0810a21"} May 20 17:07:09.717184 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:09.717149 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:09.771648 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:09.771612 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:10.575101 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:10.575069 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:27.698890 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:27.698834 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:07:27.700191 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:27.700133 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="prometheus" containerID="cri-o://9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495" gracePeriod=600 May 20 17:07:27.700739 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:27.700363 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy" containerID="cri-o://0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920" gracePeriod=600 May 20 17:07:27.700843 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:27.700573 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy-thanos" containerID="cri-o://177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015" gracePeriod=600 May 20 17:07:27.700843 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:27.700573 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy-web" containerID="cri-o://c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144" gracePeriod=600 May 20 17:07:27.700972 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:27.700592 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="config-reloader" containerID="cri-o://82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730" gracePeriod=600 May 20 17:07:27.700972 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:27.700608 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="thanos-sidecar" containerID="cri-o://a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141" gracePeriod=600 May 20 17:07:28.613693 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613657 2563 generic.go:358] "Generic (PLEG): container finished" podID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerID="177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015" exitCode=0 May 20 17:07:28.613693 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613684 2563 generic.go:358] "Generic (PLEG): container finished" podID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerID="0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920" exitCode=0 May 20 17:07:28.613693 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613690 2563 generic.go:358] "Generic (PLEG): container finished" podID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerID="a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141" exitCode=0 May 20 17:07:28.613693 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613695 2563 generic.go:358] "Generic (PLEG): container finished" podID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerID="82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730" exitCode=0 May 20 17:07:28.613693 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613702 2563 generic.go:358] "Generic (PLEG): container finished" podID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerID="9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495" exitCode=0 May 20 17:07:28.614016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613731 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerDied","Data":"177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015"} May 20 17:07:28.614016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613762 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerDied","Data":"0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920"} May 20 17:07:28.614016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613777 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerDied","Data":"a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141"} May 20 17:07:28.614016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613785 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerDied","Data":"82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730"} May 20 17:07:28.614016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.613796 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerDied","Data":"9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495"} May 20 17:07:28.943118 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:28.943092 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.084807 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.084775 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-config-out\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.084818 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-config\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.084849 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.084900 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-tls-assets\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.084928 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-metrics-client-ca\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.084956 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-rulefiles-0\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085016 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085015 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-grpc-tls\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085334 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085045 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-thanos-prometheus-http-client-file\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085334 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085091 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085334 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085119 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-tls\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085334 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085151 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-trusted-ca-bundle\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085334 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085216 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-metrics-client-certs\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085334 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085255 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-kubelet-serving-ca-bundle\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.085655 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085418 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:29.085655 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085583 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:29.085920 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.085841 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087011 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087079 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-kube-rbac-proxy\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087130 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-serving-certs-ca-bundle\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087172 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-db\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087200 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-web-config\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087237 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6xcz\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-kube-api-access-k6xcz\") pod \"47a23c03-97cd-4374-8d2a-020b64f421ed\" (UID: \"47a23c03-97cd-4374-8d2a-020b64f421ed\") " May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087487 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087507 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087523 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-metrics-client-ca\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.087834 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.087536 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.088704 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.088676 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.088790 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.088759 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:29.088967 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.088940 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.089346 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.089320 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-config-out" (OuterVolumeSpecName: "config-out") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 17:07:29.089426 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.089326 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:07:29.089426 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.089393 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.089586 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.089561 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 17:07:29.089805 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.089779 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-config" (OuterVolumeSpecName: "config") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.089927 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.089894 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.090573 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.090543 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.090661 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.090570 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.090832 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.090815 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-kube-api-access-k6xcz" (OuterVolumeSpecName: "kube-api-access-k6xcz") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "kube-api-access-k6xcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:07:29.091629 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.091605 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.102670 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.102631 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-web-config" (OuterVolumeSpecName: "web-config") pod "47a23c03-97cd-4374-8d2a-020b64f421ed" (UID: "47a23c03-97cd-4374-8d2a-020b64f421ed"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:29.188938 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188829 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-grpc-tls\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.188938 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188897 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.188938 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188912 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.188938 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188924 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.188938 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188935 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-metrics-client-certs\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.188938 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188944 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-kube-rbac-proxy\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.189232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188955 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a23c03-97cd-4374-8d2a-020b64f421ed-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.189232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188965 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-prometheus-k8s-db\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.189232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188975 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-web-config\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.189232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188986 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6xcz\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-kube-api-access-k6xcz\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.189232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.188996 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47a23c03-97cd-4374-8d2a-020b64f421ed-config-out\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.189232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.189004 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-config\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.189232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.189012 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47a23c03-97cd-4374-8d2a-020b64f421ed-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.189232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.189022 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47a23c03-97cd-4374-8d2a-020b64f421ed-tls-assets\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:07:29.619627 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.619587 2563 generic.go:358] "Generic (PLEG): container finished" podID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerID="c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144" exitCode=0 May 20 17:07:29.619800 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.619671 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerDied","Data":"c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144"} May 20 17:07:29.619800 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.619713 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47a23c03-97cd-4374-8d2a-020b64f421ed","Type":"ContainerDied","Data":"4b5b4d760f98415f553e752e74d2486b7ac932bf97695c9bde88494e69a2d169"} May 20 17:07:29.619800 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.619717 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.619800 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.619729 2563 scope.go:117] "RemoveContainer" containerID="177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015" May 20 17:07:29.628100 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.628075 2563 scope.go:117] "RemoveContainer" containerID="0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920" May 20 17:07:29.635423 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.635396 2563 scope.go:117] "RemoveContainer" containerID="c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144" May 20 17:07:29.642507 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.642477 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:07:29.642771 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.642753 2563 scope.go:117] "RemoveContainer" containerID="a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141" May 20 17:07:29.647324 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.647298 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:07:29.650784 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.650767 2563 scope.go:117] "RemoveContainer" containerID="82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730" May 20 17:07:29.657588 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.657567 2563 scope.go:117] "RemoveContainer" containerID="9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495" May 20 17:07:29.664648 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.664628 2563 scope.go:117] "RemoveContainer" containerID="8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07" May 20 17:07:29.671652 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671526 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:07:29.671712 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671675 2563 scope.go:117] "RemoveContainer" containerID="177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015" May 20 17:07:29.671921 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671904 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671924 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671942 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="prometheus" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671950 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="prometheus" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671961 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy-web" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671969 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy-web" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671979 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="config-reloader" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671984 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="config-reloader" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671993 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy-thanos" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.671998 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy-thanos" May 20 17:07:29.672020 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:07:29.671995 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015\": container with ID starting with 177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015 not found: ID does not exist" containerID="177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672035 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015"} err="failed to get container status \"177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015\": rpc error: code = NotFound desc = could not find container \"177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015\": container with ID starting with 177bc4ba70c7eabbc2461a0de28faafbdc2ec8617b5d39f54675a4a423c8c015 not found: ID does not exist" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672006 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="thanos-sidecar" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672093 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="thanos-sidecar" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672105 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="init-config-reloader" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672111 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="init-config-reloader" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672084 2563 scope.go:117] "RemoveContainer" containerID="0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672160 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="prometheus" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672166 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="config-reloader" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672175 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="thanos-sidecar" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672181 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy-thanos" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672188 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy-web" May 20 17:07:29.672397 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672195 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" containerName="kube-rbac-proxy" May 20 17:07:29.672796 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:07:29.672423 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920\": container with ID starting with 0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920 not found: ID does not exist" containerID="0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920" May 20 17:07:29.672796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672447 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920"} err="failed to get container status \"0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920\": rpc error: code = NotFound desc = could not find container \"0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920\": container with ID starting with 0683c68298f53e16d8bc134a472b4ecc3483d03d61d0574c240e3fc5b4d07920 not found: ID does not exist" May 20 17:07:29.672796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672464 2563 scope.go:117] "RemoveContainer" containerID="c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144" May 20 17:07:29.672796 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:07:29.672730 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144\": container with ID starting with c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144 not found: ID does not exist" containerID="c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144" May 20 17:07:29.672796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672761 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144"} err="failed to get container status \"c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144\": rpc error: code = NotFound desc = could not find container \"c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144\": container with ID starting with c60632862cfe6780f09bcc6dc8b3b43ee39cf28a9780cb7a60ed3e7cc9c10144 not found: ID does not exist" May 20 17:07:29.672796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.672780 2563 scope.go:117] "RemoveContainer" containerID="a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141" May 20 17:07:29.673149 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:07:29.673084 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141\": container with ID starting with a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141 not found: ID does not exist" containerID="a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141" May 20 17:07:29.673149 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.673110 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141"} err="failed to get container status \"a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141\": rpc error: code = NotFound desc = could not find container \"a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141\": container with ID starting with a5faeb5f53bf9cbdfe5844b84b0f8955d47bfcedc11360ff5d88bce91ee8c141 not found: ID does not exist" May 20 17:07:29.673149 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.673131 2563 scope.go:117] "RemoveContainer" containerID="82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730" May 20 17:07:29.673383 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:07:29.673366 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730\": container with ID starting with 82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730 not found: ID does not exist" containerID="82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730" May 20 17:07:29.673436 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.673389 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730"} err="failed to get container status \"82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730\": rpc error: code = NotFound desc = could not find container \"82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730\": container with ID starting with 82ba7db4257cd874339623a4e33916bbc14953b6c18f10b1fa539ca98184f730 not found: ID does not exist" May 20 17:07:29.673436 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.673409 2563 scope.go:117] "RemoveContainer" containerID="9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495" May 20 17:07:29.673658 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:07:29.673637 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495\": container with ID starting with 9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495 not found: ID does not exist" containerID="9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495" May 20 17:07:29.673711 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.673664 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495"} err="failed to get container status \"9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495\": rpc error: code = NotFound desc = could not find container \"9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495\": container with ID starting with 9484a72127dc0a0875c0c0f271fbd234a25db329681bc563fce377cf12d00495 not found: ID does not exist" May 20 17:07:29.673711 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.673678 2563 scope.go:117] "RemoveContainer" containerID="8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07" May 20 17:07:29.673934 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:07:29.673917 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07\": container with ID starting with 8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07 not found: ID does not exist" containerID="8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07" May 20 17:07:29.674000 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.673939 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07"} err="failed to get container status \"8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07\": rpc error: code = NotFound desc = could not find container \"8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07\": container with ID starting with 8ce41259f9e7e8ddaf7295352e64d0380528b45533db9a4e26625b682c48cd07 not found: ID does not exist" May 20 17:07:29.677375 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.677357 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.679741 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.679711 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 17:07:29.679816 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.679736 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 17:07:29.679816 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.679785 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 17:07:29.680048 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.680029 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 17:07:29.680137 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.680120 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 17:07:29.680306 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.680292 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 17:07:29.680526 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.680497 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hqrrr\"" May 20 17:07:29.680526 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.680522 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 17:07:29.680663 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.680525 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 17:07:29.680747 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.680726 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 17:07:29.680921 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.680904 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 17:07:29.681134 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.681110 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-990s533ib8ck0\"" May 20 17:07:29.681791 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.681772 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 17:07:29.683522 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.683498 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 17:07:29.685721 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.685705 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 17:07:29.695189 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.695150 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:07:29.793640 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793601 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.793751 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.793751 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.793751 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.793751 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.793925 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793758 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.793925 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6baa2139-924b-4ded-b7a1-728eee09610c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.793925 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.793925 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794061 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794061 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794061 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.793964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794061 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.794008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794061 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.794042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6baa2139-924b-4ded-b7a1-728eee09610c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794233 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.794063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-config\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794233 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.794082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjmh5\" (UniqueName: \"kubernetes.io/projected/6baa2139-924b-4ded-b7a1-728eee09610c-kube-api-access-sjmh5\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794233 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.794101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.794233 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.794159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.894829 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.894722 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.894829 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.894771 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.894829 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.894793 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895123 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.894912 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895123 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.894958 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6baa2139-924b-4ded-b7a1-728eee09610c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895123 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.894983 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895123 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895025 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895123 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895051 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895123 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895075 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895123 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895103 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895142 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895172 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6baa2139-924b-4ded-b7a1-728eee09610c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895195 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-config\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895219 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjmh5\" (UniqueName: \"kubernetes.io/projected/6baa2139-924b-4ded-b7a1-728eee09610c-kube-api-access-sjmh5\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895244 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895292 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895322 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.895457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895360 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.896214 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.895747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.896214 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.896029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.897417 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.897386 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.897851 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.897821 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.898442 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.898409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.898559 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.898537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.898817 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.898791 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.899010 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.898987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.899163 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.899139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6baa2139-924b-4ded-b7a1-728eee09610c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.900529 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.899668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-config\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.900724 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.900691 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.900808 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.900723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.900851 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.900811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6baa2139-924b-4ded-b7a1-728eee09610c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.900915 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.900852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6baa2139-924b-4ded-b7a1-728eee09610c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.900992 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.900976 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.901135 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.901115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.901606 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.901589 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6baa2139-924b-4ded-b7a1-728eee09610c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.904827 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.904809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjmh5\" (UniqueName: \"kubernetes.io/projected/6baa2139-924b-4ded-b7a1-728eee09610c-kube-api-access-sjmh5\") pod \"prometheus-k8s-0\" (UID: \"6baa2139-924b-4ded-b7a1-728eee09610c\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:29.988085 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:29.988037 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:07:30.128147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:30.128102 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 17:07:30.131268 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:07:30.131237 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6baa2139_924b_4ded_b7a1_728eee09610c.slice/crio-215b290ba3e214f8490f7d3880c539e1d55af2fe08d2b21f3253cee91db94989 WatchSource:0}: Error finding container 215b290ba3e214f8490f7d3880c539e1d55af2fe08d2b21f3253cee91db94989: Status 404 returned error can't find the container with id 215b290ba3e214f8490f7d3880c539e1d55af2fe08d2b21f3253cee91db94989 May 20 17:07:30.625085 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:30.625048 2563 generic.go:358] "Generic (PLEG): container finished" podID="6baa2139-924b-4ded-b7a1-728eee09610c" containerID="d6ccece41f179a348b0f7fd479730e66b0128398b7dfcdc03df76ce7af2c0ffb" exitCode=0 May 20 17:07:30.625085 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:30.625090 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6baa2139-924b-4ded-b7a1-728eee09610c","Type":"ContainerDied","Data":"d6ccece41f179a348b0f7fd479730e66b0128398b7dfcdc03df76ce7af2c0ffb"} May 20 17:07:30.625312 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:30.625115 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6baa2139-924b-4ded-b7a1-728eee09610c","Type":"ContainerStarted","Data":"215b290ba3e214f8490f7d3880c539e1d55af2fe08d2b21f3253cee91db94989"} May 20 17:07:30.878190 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:30.875450 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47a23c03-97cd-4374-8d2a-020b64f421ed" path="/var/lib/kubelet/pods/47a23c03-97cd-4374-8d2a-020b64f421ed/volumes" May 20 17:07:31.632034 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:31.632000 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6baa2139-924b-4ded-b7a1-728eee09610c","Type":"ContainerStarted","Data":"d85726f1b63a20bf50ced645672552bc674b99028c4c7ea78dec55f3fc9017e1"} May 20 17:07:31.632034 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:31.632034 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6baa2139-924b-4ded-b7a1-728eee09610c","Type":"ContainerStarted","Data":"d3c3c110b7fe357012c9095efe463da8aa12026c7d25bacd1f837ed3638f2665"} May 20 17:07:31.632446 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:31.632044 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6baa2139-924b-4ded-b7a1-728eee09610c","Type":"ContainerStarted","Data":"5f4241352e458bc60158e561d4ce26f47bf49ca5c0be0f52ef41ff6522b55502"} May 20 17:07:31.632446 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:31.632052 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6baa2139-924b-4ded-b7a1-728eee09610c","Type":"ContainerStarted","Data":"7eab0992898e5c34a5e98eb587fd05c40d3b1805bca28da427da48907b314570"} May 20 17:07:31.632446 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:31.632061 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6baa2139-924b-4ded-b7a1-728eee09610c","Type":"ContainerStarted","Data":"c2d3577bbcca97105ed6c3dcc8e9261d9bfc50dea157ec00b624d67234c58fba"} May 20 17:07:31.632446 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:31.632068 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6baa2139-924b-4ded-b7a1-728eee09610c","Type":"ContainerStarted","Data":"864dd83634e742510febd2108849dc0b307acc9557a2472478be8819bfdec78d"} May 20 17:07:31.659887 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:31.659820 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.659800589 podStartE2EDuration="2.659800589s" podCreationTimestamp="2026-05-20 17:07:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:07:31.658439122 +0000 UTC m=+213.431462506" watchObservedRunningTime="2026-05-20 17:07:31.659800589 +0000 UTC m=+213.432823973" May 20 17:07:34.988437 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:07:34.988398 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:08:12.551832 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.551740 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rqhfc"] May 20 17:08:12.554114 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.554097 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.556405 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.556385 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 17:08:12.563310 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.563287 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rqhfc"] May 20 17:08:12.631058 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.631014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a7a567-5b65-492c-a89e-b33a9f27b48d-original-pull-secret\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.631240 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.631102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1a7a567-5b65-492c-a89e-b33a9f27b48d-kubelet-config\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.631240 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.631120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1a7a567-5b65-492c-a89e-b33a9f27b48d-dbus\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.732314 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.732268 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a7a567-5b65-492c-a89e-b33a9f27b48d-original-pull-secret\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.732517 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.732362 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1a7a567-5b65-492c-a89e-b33a9f27b48d-kubelet-config\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.732517 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.732387 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1a7a567-5b65-492c-a89e-b33a9f27b48d-dbus\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.732517 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.732486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1a7a567-5b65-492c-a89e-b33a9f27b48d-kubelet-config\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.732659 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.732570 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1a7a567-5b65-492c-a89e-b33a9f27b48d-dbus\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.734788 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.734763 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1a7a567-5b65-492c-a89e-b33a9f27b48d-original-pull-secret\") pod \"global-pull-secret-syncer-rqhfc\" (UID: \"b1a7a567-5b65-492c-a89e-b33a9f27b48d\") " pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.864251 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.864218 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqhfc" May 20 17:08:12.990699 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:12.990664 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rqhfc"] May 20 17:08:12.993933 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:08:12.993908 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a7a567_5b65_492c_a89e_b33a9f27b48d.slice/crio-76ed300af0d7b9668a924839ad9c46be7f0ce341bae61240b32117ef64399c07 WatchSource:0}: Error finding container 76ed300af0d7b9668a924839ad9c46be7f0ce341bae61240b32117ef64399c07: Status 404 returned error can't find the container with id 76ed300af0d7b9668a924839ad9c46be7f0ce341bae61240b32117ef64399c07 May 20 17:08:13.757932 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:13.757890 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rqhfc" event={"ID":"b1a7a567-5b65-492c-a89e-b33a9f27b48d","Type":"ContainerStarted","Data":"76ed300af0d7b9668a924839ad9c46be7f0ce341bae61240b32117ef64399c07"} May 20 17:08:17.771769 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:17.771673 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rqhfc" event={"ID":"b1a7a567-5b65-492c-a89e-b33a9f27b48d","Type":"ContainerStarted","Data":"bf67d9c09b49c15ad89a53c35ed132969abb1029ee50309ba6fa850267636b39"} May 20 17:08:17.788413 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:17.788355 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rqhfc" podStartSLOduration=1.349708311 podStartE2EDuration="5.788339719s" podCreationTimestamp="2026-05-20 17:08:12 +0000 UTC" firstStartedPulling="2026-05-20 17:08:12.995856206 +0000 UTC m=+254.768879570" lastFinishedPulling="2026-05-20 17:08:17.434487616 +0000 UTC m=+259.207510978" observedRunningTime="2026-05-20 17:08:17.786103963 +0000 UTC m=+259.559127348" watchObservedRunningTime="2026-05-20 17:08:17.788339719 +0000 UTC m=+259.561363148" May 20 17:08:29.988708 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:29.988666 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:08:30.005306 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:30.005275 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:08:30.824612 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:30.824582 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 17:08:58.740617 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:58.740588 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:08:58.741219 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:58.740768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:08:58.754929 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:08:58.753912 2563 kubelet.go:1628] "Image garbage collection succeeded" May 20 17:12:21.637171 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.637134 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-qmkds"] May 20 17:12:21.639472 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.639455 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-qmkds" May 20 17:12:21.641580 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.641555 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 20 17:12:21.642399 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.642381 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 20 17:12:21.642500 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.642383 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gdvhr\"" May 20 17:12:21.649059 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.649031 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-qmkds"] May 20 17:12:21.763492 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.763447 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s2p9\" (UniqueName: \"kubernetes.io/projected/76e3b7e7-27ae-45a6-a579-e010510d395f-kube-api-access-2s2p9\") pod \"cert-manager-79c8d999ff-qmkds\" (UID: \"76e3b7e7-27ae-45a6-a579-e010510d395f\") " pod="cert-manager/cert-manager-79c8d999ff-qmkds" May 20 17:12:21.763492 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.763492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76e3b7e7-27ae-45a6-a579-e010510d395f-bound-sa-token\") pod \"cert-manager-79c8d999ff-qmkds\" (UID: \"76e3b7e7-27ae-45a6-a579-e010510d395f\") " pod="cert-manager/cert-manager-79c8d999ff-qmkds" May 20 17:12:21.864404 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.864367 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s2p9\" (UniqueName: \"kubernetes.io/projected/76e3b7e7-27ae-45a6-a579-e010510d395f-kube-api-access-2s2p9\") pod \"cert-manager-79c8d999ff-qmkds\" (UID: \"76e3b7e7-27ae-45a6-a579-e010510d395f\") " pod="cert-manager/cert-manager-79c8d999ff-qmkds" May 20 17:12:21.864404 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.864407 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76e3b7e7-27ae-45a6-a579-e010510d395f-bound-sa-token\") pod \"cert-manager-79c8d999ff-qmkds\" (UID: \"76e3b7e7-27ae-45a6-a579-e010510d395f\") " pod="cert-manager/cert-manager-79c8d999ff-qmkds" May 20 17:12:21.872612 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.872580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76e3b7e7-27ae-45a6-a579-e010510d395f-bound-sa-token\") pod \"cert-manager-79c8d999ff-qmkds\" (UID: \"76e3b7e7-27ae-45a6-a579-e010510d395f\") " pod="cert-manager/cert-manager-79c8d999ff-qmkds" May 20 17:12:21.872738 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.872644 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s2p9\" (UniqueName: \"kubernetes.io/projected/76e3b7e7-27ae-45a6-a579-e010510d395f-kube-api-access-2s2p9\") pod \"cert-manager-79c8d999ff-qmkds\" (UID: \"76e3b7e7-27ae-45a6-a579-e010510d395f\") " pod="cert-manager/cert-manager-79c8d999ff-qmkds" May 20 17:12:21.956383 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:21.956295 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-qmkds" May 20 17:12:22.084784 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:22.084748 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-qmkds"] May 20 17:12:22.089066 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:12:22.089039 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76e3b7e7_27ae_45a6_a579_e010510d395f.slice/crio-7f71392b69f6dd53bea58bdaf24c44ad3a1caf058cca93c578d790fc7421b917 WatchSource:0}: Error finding container 7f71392b69f6dd53bea58bdaf24c44ad3a1caf058cca93c578d790fc7421b917: Status 404 returned error can't find the container with id 7f71392b69f6dd53bea58bdaf24c44ad3a1caf058cca93c578d790fc7421b917 May 20 17:12:22.090894 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:22.090860 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:12:22.478661 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:22.478625 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-qmkds" event={"ID":"76e3b7e7-27ae-45a6-a579-e010510d395f","Type":"ContainerStarted","Data":"7f71392b69f6dd53bea58bdaf24c44ad3a1caf058cca93c578d790fc7421b917"} May 20 17:12:26.492575 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:26.492533 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-qmkds" event={"ID":"76e3b7e7-27ae-45a6-a579-e010510d395f","Type":"ContainerStarted","Data":"f21ef83e1ccccc9d7bcbd63a3863c77584ccbb97054ec90e1c58a33463191312"} May 20 17:12:26.508203 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:26.508156 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-qmkds" podStartSLOduration=2.08656598 podStartE2EDuration="5.508141605s" podCreationTimestamp="2026-05-20 17:12:21 +0000 UTC" firstStartedPulling="2026-05-20 17:12:22.091005178 +0000 UTC m=+503.864028542" lastFinishedPulling="2026-05-20 17:12:25.512580802 +0000 UTC m=+507.285604167" observedRunningTime="2026-05-20 17:12:26.507337008 +0000 UTC m=+508.280360405" watchObservedRunningTime="2026-05-20 17:12:26.508141605 +0000 UTC m=+508.281164986" May 20 17:12:45.684517 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.684476 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2"] May 20 17:12:45.687126 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.687101 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.689852 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.689828 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 20 17:12:45.690061 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.690041 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 20 17:12:45.690239 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.690211 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 20 17:12:45.690345 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.690309 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 20 17:12:45.690464 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.690448 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-chgpn\"" May 20 17:12:45.703168 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.703134 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2"] May 20 17:12:45.761600 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.761554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/915b54d1-bf24-4eb8-abc0-4587ead06efe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.761796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.761615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb5s2\" (UniqueName: \"kubernetes.io/projected/915b54d1-bf24-4eb8-abc0-4587ead06efe-kube-api-access-fb5s2\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.761796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.761636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/915b54d1-bf24-4eb8-abc0-4587ead06efe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.862942 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.862884 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fb5s2\" (UniqueName: \"kubernetes.io/projected/915b54d1-bf24-4eb8-abc0-4587ead06efe-kube-api-access-fb5s2\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.862942 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.862950 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/915b54d1-bf24-4eb8-abc0-4587ead06efe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.863217 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.863029 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/915b54d1-bf24-4eb8-abc0-4587ead06efe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.865558 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.865531 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/915b54d1-bf24-4eb8-abc0-4587ead06efe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.865699 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.865675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/915b54d1-bf24-4eb8-abc0-4587ead06efe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.871123 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.871100 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb5s2\" (UniqueName: \"kubernetes.io/projected/915b54d1-bf24-4eb8-abc0-4587ead06efe-kube-api-access-fb5s2\") pod \"opendatahub-operator-controller-manager-5c544869d7-f2bv2\" (UID: \"915b54d1-bf24-4eb8-abc0-4587ead06efe\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:45.997984 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:45.997894 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:46.135451 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:46.135425 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2"] May 20 17:12:46.137886 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:12:46.137840 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915b54d1_bf24_4eb8_abc0_4587ead06efe.slice/crio-6b72184712124803f2d456245ffbcad89bd8475abfff14a273c40c5cd272aeba WatchSource:0}: Error finding container 6b72184712124803f2d456245ffbcad89bd8475abfff14a273c40c5cd272aeba: Status 404 returned error can't find the container with id 6b72184712124803f2d456245ffbcad89bd8475abfff14a273c40c5cd272aeba May 20 17:12:46.552648 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:46.552610 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" event={"ID":"915b54d1-bf24-4eb8-abc0-4587ead06efe","Type":"ContainerStarted","Data":"6b72184712124803f2d456245ffbcad89bd8475abfff14a273c40c5cd272aeba"} May 20 17:12:48.753348 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.753319 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl"] May 20 17:12:48.755799 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.755775 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.758964 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.758940 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 20 17:12:48.759845 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.759831 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 20 17:12:48.759981 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.759961 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 20 17:12:48.760191 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.760052 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 20 17:12:48.760191 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.760100 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-588dz\"" May 20 17:12:48.760191 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.760155 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 20 17:12:48.772632 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.772599 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl"] May 20 17:12:48.788724 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.788693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-cert\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.788904 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.788775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzzvx\" (UniqueName: \"kubernetes.io/projected/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-kube-api-access-bzzvx\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.788904 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.788835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-manager-config\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.788904 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.788854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-metrics-cert\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.889310 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.889274 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-manager-config\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.889310 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.889316 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-metrics-cert\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.889557 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.889350 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-cert\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.889557 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.889415 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzzvx\" (UniqueName: \"kubernetes.io/projected/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-kube-api-access-bzzvx\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.890069 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.890000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-manager-config\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.892550 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.892526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-cert\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.892659 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.892580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-metrics-cert\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:48.899190 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:48.899163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzzvx\" (UniqueName: \"kubernetes.io/projected/8f8ca3db-60d9-45c8-85c9-9f90b276f2ee-kube-api-access-bzzvx\") pod \"lws-controller-manager-7455d58f8d-2s8pl\" (UID: \"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee\") " pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:49.066138 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:49.066038 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:49.200274 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:49.200242 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl"] May 20 17:12:49.203852 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:12:49.203823 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8ca3db_60d9_45c8_85c9_9f90b276f2ee.slice/crio-864cd9425232a785f4c370e791381a15f0035c549bc04f5e62148b697ed11778 WatchSource:0}: Error finding container 864cd9425232a785f4c370e791381a15f0035c549bc04f5e62148b697ed11778: Status 404 returned error can't find the container with id 864cd9425232a785f4c370e791381a15f0035c549bc04f5e62148b697ed11778 May 20 17:12:49.563591 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:49.563558 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" event={"ID":"915b54d1-bf24-4eb8-abc0-4587ead06efe","Type":"ContainerStarted","Data":"3389f6df0596fc5c3437898999adf5d44fe0e85971740cf05e6129cdf305e58f"} May 20 17:12:49.563796 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:49.563616 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:12:49.564542 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:49.564514 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" event={"ID":"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee","Type":"ContainerStarted","Data":"864cd9425232a785f4c370e791381a15f0035c549bc04f5e62148b697ed11778"} May 20 17:12:49.596933 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:49.596852 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" podStartSLOduration=2.039809738 podStartE2EDuration="4.596838187s" podCreationTimestamp="2026-05-20 17:12:45 +0000 UTC" firstStartedPulling="2026-05-20 17:12:46.139525675 +0000 UTC m=+527.912549038" lastFinishedPulling="2026-05-20 17:12:48.696554121 +0000 UTC m=+530.469577487" observedRunningTime="2026-05-20 17:12:49.59569967 +0000 UTC m=+531.368723080" watchObservedRunningTime="2026-05-20 17:12:49.596838187 +0000 UTC m=+531.369861571" May 20 17:12:53.580042 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:53.580008 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" event={"ID":"8f8ca3db-60d9-45c8-85c9-9f90b276f2ee","Type":"ContainerStarted","Data":"c13b5721fc825ea1cc50113fdd407ef2fefda0bb651f24c226af40044133fdfb"} May 20 17:12:53.580440 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:53.580064 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:12:53.620843 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:12:53.620788 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" podStartSLOduration=2.222014326 podStartE2EDuration="5.620773156s" podCreationTimestamp="2026-05-20 17:12:48 +0000 UTC" firstStartedPulling="2026-05-20 17:12:49.205795975 +0000 UTC m=+530.978819337" lastFinishedPulling="2026-05-20 17:12:52.604554805 +0000 UTC m=+534.377578167" observedRunningTime="2026-05-20 17:12:53.618976976 +0000 UTC m=+535.392000360" watchObservedRunningTime="2026-05-20 17:12:53.620773156 +0000 UTC m=+535.393796541" May 20 17:13:00.570921 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:00.570891 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-f2bv2" May 20 17:13:04.585329 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.585297 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7455d58f8d-2s8pl" May 20 17:13:04.807990 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.807959 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57795f5895-5gbr7"] May 20 17:13:04.812957 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.812929 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:04.817114 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.817089 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 20 17:13:04.818141 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.817686 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p5xkw\"" May 20 17:13:04.818141 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.817755 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 20 17:13:04.818141 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.817800 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 20 17:13:04.821626 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.821450 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 20 17:13:04.831524 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.831490 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57795f5895-5gbr7"] May 20 17:13:04.937037 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.936997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a218409-bd71-4f51-b557-4c58db7a4a9b-tmp\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:04.937216 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.937061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a218409-bd71-4f51-b557-4c58db7a4a9b-tls-certs\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:04.937216 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:04.937092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snjh4\" (UniqueName: \"kubernetes.io/projected/8a218409-bd71-4f51-b557-4c58db7a4a9b-kube-api-access-snjh4\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:05.038201 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.038165 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a218409-bd71-4f51-b557-4c58db7a4a9b-tls-certs\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:05.038353 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.038215 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snjh4\" (UniqueName: \"kubernetes.io/projected/8a218409-bd71-4f51-b557-4c58db7a4a9b-kube-api-access-snjh4\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:05.038353 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.038263 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a218409-bd71-4f51-b557-4c58db7a4a9b-tmp\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:05.040674 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.040649 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a218409-bd71-4f51-b557-4c58db7a4a9b-tmp\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:05.040860 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.040844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a218409-bd71-4f51-b557-4c58db7a4a9b-tls-certs\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:05.047060 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.047033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snjh4\" (UniqueName: \"kubernetes.io/projected/8a218409-bd71-4f51-b557-4c58db7a4a9b-kube-api-access-snjh4\") pod \"kube-auth-proxy-57795f5895-5gbr7\" (UID: \"8a218409-bd71-4f51-b557-4c58db7a4a9b\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:05.124995 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.124942 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" May 20 17:13:05.260984 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.260946 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57795f5895-5gbr7"] May 20 17:13:05.264345 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:13:05.264317 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a218409_bd71_4f51_b557_4c58db7a4a9b.slice/crio-164f37e6cb43b88d723f71960fb889c33166e794beb12427095f71d4eb333164 WatchSource:0}: Error finding container 164f37e6cb43b88d723f71960fb889c33166e794beb12427095f71d4eb333164: Status 404 returned error can't find the container with id 164f37e6cb43b88d723f71960fb889c33166e794beb12427095f71d4eb333164 May 20 17:13:05.616641 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:05.616600 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" event={"ID":"8a218409-bd71-4f51-b557-4c58db7a4a9b","Type":"ContainerStarted","Data":"164f37e6cb43b88d723f71960fb889c33166e794beb12427095f71d4eb333164"} May 20 17:13:08.627395 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:08.627359 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" event={"ID":"8a218409-bd71-4f51-b557-4c58db7a4a9b","Type":"ContainerStarted","Data":"a5771e8a7ce7df8ae6488b05b9cea8310b4214def2fbb58ab7feaf1a18905252"} May 20 17:13:58.766783 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:58.766746 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:13:58.767839 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:13:58.767818 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:15:41.545891 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.545806 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57795f5895-5gbr7" podStartSLOduration=154.427635454 podStartE2EDuration="2m37.545789742s" podCreationTimestamp="2026-05-20 17:13:04 +0000 UTC" firstStartedPulling="2026-05-20 17:13:05.266170173 +0000 UTC m=+547.039193551" lastFinishedPulling="2026-05-20 17:13:08.384324458 +0000 UTC m=+550.157347839" observedRunningTime="2026-05-20 17:13:08.658334748 +0000 UTC m=+550.431358152" watchObservedRunningTime="2026-05-20 17:15:41.545789742 +0000 UTC m=+703.318813140" May 20 17:15:41.546646 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.546625 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz"] May 20 17:15:41.549931 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.549912 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.552858 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.552834 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 20 17:15:41.553012 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.552990 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-944l2\"" May 20 17:15:41.571956 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.571926 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz"] May 20 17:15:41.699563 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/077847bf-35c6-4b2e-b458-855511d80e15-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.699563 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.699563 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.699784 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.699784 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.699784 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/077847bf-35c6-4b2e-b458-855511d80e15-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.699784 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p79z\" (UniqueName: \"kubernetes.io/projected/077847bf-35c6-4b2e-b458-855511d80e15-kube-api-access-2p79z\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.699965 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.699965 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.699837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/077847bf-35c6-4b2e-b458-855511d80e15-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800475 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800431 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800475 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800477 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/077847bf-35c6-4b2e-b458-855511d80e15-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800672 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800600 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/077847bf-35c6-4b2e-b458-855511d80e15-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800672 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800644 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800753 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800673 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800753 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800723 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800848 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800762 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800848 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800996 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800795 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/077847bf-35c6-4b2e-b458-855511d80e15-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800996 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800926 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p79z\" (UniqueName: \"kubernetes.io/projected/077847bf-35c6-4b2e-b458-855511d80e15-kube-api-access-2p79z\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.800996 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.800989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.801147 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.801100 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.801330 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.801309 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.801627 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.801604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/077847bf-35c6-4b2e-b458-855511d80e15-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.803247 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.803217 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/077847bf-35c6-4b2e-b458-855511d80e15-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.803408 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.803390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/077847bf-35c6-4b2e-b458-855511d80e15-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.809535 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.809509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p79z\" (UniqueName: \"kubernetes.io/projected/077847bf-35c6-4b2e-b458-855511d80e15-kube-api-access-2p79z\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.809695 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.809677 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/077847bf-35c6-4b2e-b458-855511d80e15-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kqphz\" (UID: \"077847bf-35c6-4b2e-b458-855511d80e15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:41.860519 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:41.860484 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:42.000528 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:42.000503 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz"] May 20 17:15:42.003156 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:15:42.003124 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077847bf_35c6_4b2e_b458_855511d80e15.slice/crio-10d6f48685f069508ee8801189643ddbfede2aa70b14d3eec71ae3660e90ec4f WatchSource:0}: Error finding container 10d6f48685f069508ee8801189643ddbfede2aa70b14d3eec71ae3660e90ec4f: Status 404 returned error can't find the container with id 10d6f48685f069508ee8801189643ddbfede2aa70b14d3eec71ae3660e90ec4f May 20 17:15:42.129388 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:42.129353 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" event={"ID":"077847bf-35c6-4b2e-b458-855511d80e15","Type":"ContainerStarted","Data":"10d6f48685f069508ee8801189643ddbfede2aa70b14d3eec71ae3660e90ec4f"} May 20 17:15:44.497733 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:44.497695 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 20 17:15:44.498028 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:44.497770 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 20 17:15:44.498028 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:44.497817 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 20 17:15:45.142605 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.142564 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" event={"ID":"077847bf-35c6-4b2e-b458-855511d80e15","Type":"ContainerStarted","Data":"46d5da2d91c4ef3034e6f9469cedc8b1192c189caeb70d0af3a095c270191cc2"} May 20 17:15:45.163042 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.162989 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" podStartSLOduration=1.6707603629999999 podStartE2EDuration="4.162973903s" podCreationTimestamp="2026-05-20 17:15:41 +0000 UTC" firstStartedPulling="2026-05-20 17:15:42.005212215 +0000 UTC m=+703.778235578" lastFinishedPulling="2026-05-20 17:15:44.497425755 +0000 UTC m=+706.270449118" observedRunningTime="2026-05-20 17:15:45.160560774 +0000 UTC m=+706.933584160" watchObservedRunningTime="2026-05-20 17:15:45.162973903 +0000 UTC m=+706.935997288" May 20 17:15:45.683782 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.683740 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5nhb2"] May 20 17:15:45.687229 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.687211 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:45.689936 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.689914 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 20 17:15:45.690927 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.690906 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 20 17:15:45.690927 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.690921 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vdts6\"" May 20 17:15:45.691051 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.690907 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 20 17:15:45.694728 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.694577 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5nhb2"] May 20 17:15:45.786075 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.786046 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5nhb2"] May 20 17:15:45.841323 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.841281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2885148-d8bb-4f5b-9289-f0788c72cabd-config-file\") pod \"limitador-limitador-7d549b5b-5nhb2\" (UID: \"e2885148-d8bb-4f5b-9289-f0788c72cabd\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:45.841505 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.841381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrdhr\" (UniqueName: \"kubernetes.io/projected/e2885148-d8bb-4f5b-9289-f0788c72cabd-kube-api-access-nrdhr\") pod \"limitador-limitador-7d549b5b-5nhb2\" (UID: \"e2885148-d8bb-4f5b-9289-f0788c72cabd\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:45.860912 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.860857 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:45.865801 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.865777 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:45.942914 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.942786 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdhr\" (UniqueName: \"kubernetes.io/projected/e2885148-d8bb-4f5b-9289-f0788c72cabd-kube-api-access-nrdhr\") pod \"limitador-limitador-7d549b5b-5nhb2\" (UID: \"e2885148-d8bb-4f5b-9289-f0788c72cabd\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:45.942914 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.942856 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2885148-d8bb-4f5b-9289-f0788c72cabd-config-file\") pod \"limitador-limitador-7d549b5b-5nhb2\" (UID: \"e2885148-d8bb-4f5b-9289-f0788c72cabd\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:45.943479 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.943458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2885148-d8bb-4f5b-9289-f0788c72cabd-config-file\") pod \"limitador-limitador-7d549b5b-5nhb2\" (UID: \"e2885148-d8bb-4f5b-9289-f0788c72cabd\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:45.951863 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.951839 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrdhr\" (UniqueName: \"kubernetes.io/projected/e2885148-d8bb-4f5b-9289-f0788c72cabd-kube-api-access-nrdhr\") pod \"limitador-limitador-7d549b5b-5nhb2\" (UID: \"e2885148-d8bb-4f5b-9289-f0788c72cabd\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:45.998105 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:45.998071 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:46.143311 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:46.143275 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5nhb2"] May 20 17:15:46.146068 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:15:46.146028 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2885148_d8bb_4f5b_9289_f0788c72cabd.slice/crio-b3694a368998f5a6069a2371435dfb7c104f3c187cb5b243b8b1adb066ffcbf2 WatchSource:0}: Error finding container b3694a368998f5a6069a2371435dfb7c104f3c187cb5b243b8b1adb066ffcbf2: Status 404 returned error can't find the container with id b3694a368998f5a6069a2371435dfb7c104f3c187cb5b243b8b1adb066ffcbf2 May 20 17:15:46.146569 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:46.146549 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:46.147776 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:46.147750 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kqphz" May 20 17:15:47.153011 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:47.152931 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" event={"ID":"e2885148-d8bb-4f5b-9289-f0788c72cabd","Type":"ContainerStarted","Data":"b3694a368998f5a6069a2371435dfb7c104f3c187cb5b243b8b1adb066ffcbf2"} May 20 17:15:49.160908 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:49.160847 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" event={"ID":"e2885148-d8bb-4f5b-9289-f0788c72cabd","Type":"ContainerStarted","Data":"04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc"} May 20 17:15:49.161296 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:49.160993 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:15:49.179580 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:15:49.179471 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" podStartSLOduration=1.3645176110000001 podStartE2EDuration="4.179454424s" podCreationTimestamp="2026-05-20 17:15:45 +0000 UTC" firstStartedPulling="2026-05-20 17:15:46.147946111 +0000 UTC m=+707.920969488" lastFinishedPulling="2026-05-20 17:15:48.962882923 +0000 UTC m=+710.735906301" observedRunningTime="2026-05-20 17:15:49.179381299 +0000 UTC m=+710.952404684" watchObservedRunningTime="2026-05-20 17:15:49.179454424 +0000 UTC m=+710.952477810" May 20 17:16:00.164958 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:00.164926 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:16:03.276426 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:03.276390 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5nhb2"] May 20 17:16:03.276816 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:03.276621 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" podUID="e2885148-d8bb-4f5b-9289-f0788c72cabd" containerName="limitador" containerID="cri-o://04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc" gracePeriod=30 May 20 17:16:03.830854 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:03.830828 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:16:03.915651 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:03.915611 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2885148-d8bb-4f5b-9289-f0788c72cabd-config-file\") pod \"e2885148-d8bb-4f5b-9289-f0788c72cabd\" (UID: \"e2885148-d8bb-4f5b-9289-f0788c72cabd\") " May 20 17:16:03.915827 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:03.915729 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrdhr\" (UniqueName: \"kubernetes.io/projected/e2885148-d8bb-4f5b-9289-f0788c72cabd-kube-api-access-nrdhr\") pod \"e2885148-d8bb-4f5b-9289-f0788c72cabd\" (UID: \"e2885148-d8bb-4f5b-9289-f0788c72cabd\") " May 20 17:16:03.915993 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:03.915967 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2885148-d8bb-4f5b-9289-f0788c72cabd-config-file" (OuterVolumeSpecName: "config-file") pod "e2885148-d8bb-4f5b-9289-f0788c72cabd" (UID: "e2885148-d8bb-4f5b-9289-f0788c72cabd"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:16:03.918128 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:03.918102 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2885148-d8bb-4f5b-9289-f0788c72cabd-kube-api-access-nrdhr" (OuterVolumeSpecName: "kube-api-access-nrdhr") pod "e2885148-d8bb-4f5b-9289-f0788c72cabd" (UID: "e2885148-d8bb-4f5b-9289-f0788c72cabd"). InnerVolumeSpecName "kube-api-access-nrdhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:16:04.017156 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.017119 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2885148-d8bb-4f5b-9289-f0788c72cabd-config-file\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:16:04.017156 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.017151 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrdhr\" (UniqueName: \"kubernetes.io/projected/e2885148-d8bb-4f5b-9289-f0788c72cabd-kube-api-access-nrdhr\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:16:04.211695 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.211604 2563 generic.go:358] "Generic (PLEG): container finished" podID="e2885148-d8bb-4f5b-9289-f0788c72cabd" containerID="04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc" exitCode=0 May 20 17:16:04.211695 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.211678 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" May 20 17:16:04.211955 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.211687 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" event={"ID":"e2885148-d8bb-4f5b-9289-f0788c72cabd","Type":"ContainerDied","Data":"04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc"} May 20 17:16:04.211955 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.211725 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5nhb2" event={"ID":"e2885148-d8bb-4f5b-9289-f0788c72cabd","Type":"ContainerDied","Data":"b3694a368998f5a6069a2371435dfb7c104f3c187cb5b243b8b1adb066ffcbf2"} May 20 17:16:04.211955 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.211741 2563 scope.go:117] "RemoveContainer" containerID="04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc" May 20 17:16:04.220532 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.220512 2563 scope.go:117] "RemoveContainer" containerID="04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc" May 20 17:16:04.220810 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:16:04.220787 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc\": container with ID starting with 04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc not found: ID does not exist" containerID="04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc" May 20 17:16:04.220848 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.220821 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc"} err="failed to get container status \"04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc\": rpc error: code = NotFound desc = could not find container \"04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc\": container with ID starting with 04e088514fb43a4cb965d22c6eb15405b5953668b299ac83ef9373bceb62e9dc not found: ID does not exist" May 20 17:16:04.231827 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.231801 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5nhb2"] May 20 17:16:04.235544 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.235521 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5nhb2"] May 20 17:16:04.873026 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:04.872994 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2885148-d8bb-4f5b-9289-f0788c72cabd" path="/var/lib/kubelet/pods/e2885148-d8bb-4f5b-9289-f0788c72cabd/volumes" May 20 17:16:07.055232 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.055197 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-jw4d6"] May 20 17:16:07.055706 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.055688 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2885148-d8bb-4f5b-9289-f0788c72cabd" containerName="limitador" May 20 17:16:07.055749 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.055712 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2885148-d8bb-4f5b-9289-f0788c72cabd" containerName="limitador" May 20 17:16:07.055831 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.055819 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2885148-d8bb-4f5b-9289-f0788c72cabd" containerName="limitador" May 20 17:16:07.060878 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.060849 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:07.064205 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.064181 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tvw6z\"" May 20 17:16:07.064838 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.064816 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 20 17:16:07.066821 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.066792 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-jw4d6"] May 20 17:16:07.149543 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.149501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38eacf95-a076-4836-9d92-03423bd5da1c-data\") pod \"postgres-68c4fbbd6f-jw4d6\" (UID: \"38eacf95-a076-4836-9d92-03423bd5da1c\") " pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:07.149728 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.149612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhj9w\" (UniqueName: \"kubernetes.io/projected/38eacf95-a076-4836-9d92-03423bd5da1c-kube-api-access-lhj9w\") pod \"postgres-68c4fbbd6f-jw4d6\" (UID: \"38eacf95-a076-4836-9d92-03423bd5da1c\") " pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:07.251069 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.251031 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38eacf95-a076-4836-9d92-03423bd5da1c-data\") pod \"postgres-68c4fbbd6f-jw4d6\" (UID: \"38eacf95-a076-4836-9d92-03423bd5da1c\") " pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:07.251312 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.251129 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhj9w\" (UniqueName: \"kubernetes.io/projected/38eacf95-a076-4836-9d92-03423bd5da1c-kube-api-access-lhj9w\") pod \"postgres-68c4fbbd6f-jw4d6\" (UID: \"38eacf95-a076-4836-9d92-03423bd5da1c\") " pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:07.251415 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.251397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38eacf95-a076-4836-9d92-03423bd5da1c-data\") pod \"postgres-68c4fbbd6f-jw4d6\" (UID: \"38eacf95-a076-4836-9d92-03423bd5da1c\") " pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:07.260703 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.260671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhj9w\" (UniqueName: \"kubernetes.io/projected/38eacf95-a076-4836-9d92-03423bd5da1c-kube-api-access-lhj9w\") pod \"postgres-68c4fbbd6f-jw4d6\" (UID: \"38eacf95-a076-4836-9d92-03423bd5da1c\") " pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:07.373389 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.373359 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:07.502741 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:07.502626 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-jw4d6"] May 20 17:16:07.505409 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:16:07.505377 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38eacf95_a076_4836_9d92_03423bd5da1c.slice/crio-ca40e5f244f8aa490754a4964475486a105d212c720b2da75851670db1aa0885 WatchSource:0}: Error finding container ca40e5f244f8aa490754a4964475486a105d212c720b2da75851670db1aa0885: Status 404 returned error can't find the container with id ca40e5f244f8aa490754a4964475486a105d212c720b2da75851670db1aa0885 May 20 17:16:08.228540 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:08.228502 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-jw4d6" event={"ID":"38eacf95-a076-4836-9d92-03423bd5da1c","Type":"ContainerStarted","Data":"ca40e5f244f8aa490754a4964475486a105d212c720b2da75851670db1aa0885"} May 20 17:16:13.248056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:13.248012 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-jw4d6" event={"ID":"38eacf95-a076-4836-9d92-03423bd5da1c","Type":"ContainerStarted","Data":"587712bb16496683a5a4c80d34f6ec82d40531a61c490d7ffb661431f92ff34b"} May 20 17:16:13.248469 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:13.248094 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:13.276218 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:13.276162 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-jw4d6" podStartSLOduration=1.265615718 podStartE2EDuration="6.276146568s" podCreationTimestamp="2026-05-20 17:16:07 +0000 UTC" firstStartedPulling="2026-05-20 17:16:07.50667682 +0000 UTC m=+729.279700187" lastFinishedPulling="2026-05-20 17:16:12.517207669 +0000 UTC m=+734.290231037" observedRunningTime="2026-05-20 17:16:13.274009186 +0000 UTC m=+735.047032584" watchObservedRunningTime="2026-05-20 17:16:13.276146568 +0000 UTC m=+735.049169953" May 20 17:16:19.281791 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:19.281759 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-jw4d6" May 20 17:16:19.823753 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:19.823714 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vd86"] May 20 17:16:19.827154 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:19.827138 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vd86" May 20 17:16:19.829658 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:19.829634 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jfm79\"" May 20 17:16:19.829771 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:19.829662 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 20 17:16:19.830594 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:19.830576 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 20 17:16:19.835478 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:19.835456 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vd86"] May 20 17:16:19.972056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:19.972013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kdbj\" (UniqueName: \"kubernetes.io/projected/03792630-b8e2-4720-80ee-87e3b82e8618-kube-api-access-8kdbj\") pod \"authorino-8b475cf9f-8vd86\" (UID: \"03792630-b8e2-4720-80ee-87e3b82e8618\") " pod="kuadrant-system/authorino-8b475cf9f-8vd86" May 20 17:16:20.072747 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.072702 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kdbj\" (UniqueName: \"kubernetes.io/projected/03792630-b8e2-4720-80ee-87e3b82e8618-kube-api-access-8kdbj\") pod \"authorino-8b475cf9f-8vd86\" (UID: \"03792630-b8e2-4720-80ee-87e3b82e8618\") " pod="kuadrant-system/authorino-8b475cf9f-8vd86" May 20 17:16:20.091049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.091015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kdbj\" (UniqueName: \"kubernetes.io/projected/03792630-b8e2-4720-80ee-87e3b82e8618-kube-api-access-8kdbj\") pod \"authorino-8b475cf9f-8vd86\" (UID: \"03792630-b8e2-4720-80ee-87e3b82e8618\") " pod="kuadrant-system/authorino-8b475cf9f-8vd86" May 20 17:16:20.121689 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.121657 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vd86"] May 20 17:16:20.121937 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.121925 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vd86" May 20 17:16:20.256100 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.256066 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vd86"] May 20 17:16:20.258964 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:16:20.258934 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03792630_b8e2_4720_80ee_87e3b82e8618.slice/crio-8e38eb9988aeb6a11114919918bc158d97c539d61d73a552ed8ad4ce67246cb0 WatchSource:0}: Error finding container 8e38eb9988aeb6a11114919918bc158d97c539d61d73a552ed8ad4ce67246cb0: Status 404 returned error can't find the container with id 8e38eb9988aeb6a11114919918bc158d97c539d61d73a552ed8ad4ce67246cb0 May 20 17:16:20.270133 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.270103 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-8vd86" event={"ID":"03792630-b8e2-4720-80ee-87e3b82e8618","Type":"ContainerStarted","Data":"8e38eb9988aeb6a11114919918bc158d97c539d61d73a552ed8ad4ce67246cb0"} May 20 17:16:20.287933 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.287902 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56b8775646-hgdgv"] May 20 17:16:20.292263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.292243 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:16:20.294853 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.294834 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 20 17:16:20.301861 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.301827 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56b8775646-hgdgv"] May 20 17:16:20.375636 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.375550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-tls-cert\") pod \"authorino-56b8775646-hgdgv\" (UID: \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\") " pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:16:20.375636 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.375626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-576kq\" (UniqueName: \"kubernetes.io/projected/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-kube-api-access-576kq\") pod \"authorino-56b8775646-hgdgv\" (UID: \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\") " pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:16:20.476750 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.476709 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-tls-cert\") pod \"authorino-56b8775646-hgdgv\" (UID: \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\") " pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:16:20.476954 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.476783 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-576kq\" (UniqueName: \"kubernetes.io/projected/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-kube-api-access-576kq\") pod \"authorino-56b8775646-hgdgv\" (UID: \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\") " pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:16:20.479338 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.479315 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-tls-cert\") pod \"authorino-56b8775646-hgdgv\" (UID: \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\") " pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:16:20.485758 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.485737 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-576kq\" (UniqueName: \"kubernetes.io/projected/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-kube-api-access-576kq\") pod \"authorino-56b8775646-hgdgv\" (UID: \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\") " pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:16:20.602190 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.602156 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:16:20.748710 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:20.748679 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56b8775646-hgdgv"] May 20 17:16:20.751046 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:16:20.751010 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a77cfb8_c7a0_4983_9ca9_14b43b5e349b.slice/crio-d93cb07b3f30a1f712dbdd50d0d6a2293dc64f9ce5ca8112c821bbd70c1f2f4c WatchSource:0}: Error finding container d93cb07b3f30a1f712dbdd50d0d6a2293dc64f9ce5ca8112c821bbd70c1f2f4c: Status 404 returned error can't find the container with id d93cb07b3f30a1f712dbdd50d0d6a2293dc64f9ce5ca8112c821bbd70c1f2f4c May 20 17:16:21.281416 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:21.281355 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56b8775646-hgdgv" event={"ID":"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b","Type":"ContainerStarted","Data":"d93cb07b3f30a1f712dbdd50d0d6a2293dc64f9ce5ca8112c821bbd70c1f2f4c"} May 20 17:16:24.294696 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.294655 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-8vd86" event={"ID":"03792630-b8e2-4720-80ee-87e3b82e8618","Type":"ContainerStarted","Data":"3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a"} May 20 17:16:24.295249 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.294712 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-8vd86" podUID="03792630-b8e2-4720-80ee-87e3b82e8618" containerName="authorino" containerID="cri-o://3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a" gracePeriod=30 May 20 17:16:24.296291 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.296263 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56b8775646-hgdgv" event={"ID":"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b","Type":"ContainerStarted","Data":"68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882"} May 20 17:16:24.318896 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.318416 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-8vd86" podStartSLOduration=1.880974461 podStartE2EDuration="5.31838567s" podCreationTimestamp="2026-05-20 17:16:19 +0000 UTC" firstStartedPulling="2026-05-20 17:16:20.260235131 +0000 UTC m=+742.033258494" lastFinishedPulling="2026-05-20 17:16:23.69764633 +0000 UTC m=+745.470669703" observedRunningTime="2026-05-20 17:16:24.31400978 +0000 UTC m=+746.087033176" watchObservedRunningTime="2026-05-20 17:16:24.31838567 +0000 UTC m=+746.091409058" May 20 17:16:24.341182 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.341133 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-56b8775646-hgdgv" podStartSLOduration=1.384605055 podStartE2EDuration="4.341117929s" podCreationTimestamp="2026-05-20 17:16:20 +0000 UTC" firstStartedPulling="2026-05-20 17:16:20.752853098 +0000 UTC m=+742.525876461" lastFinishedPulling="2026-05-20 17:16:23.709365972 +0000 UTC m=+745.482389335" observedRunningTime="2026-05-20 17:16:24.34100682 +0000 UTC m=+746.114030202" watchObservedRunningTime="2026-05-20 17:16:24.341117929 +0000 UTC m=+746.114141313" May 20 17:16:24.541405 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.541378 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vd86" May 20 17:16:24.620300 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.620265 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kdbj\" (UniqueName: \"kubernetes.io/projected/03792630-b8e2-4720-80ee-87e3b82e8618-kube-api-access-8kdbj\") pod \"03792630-b8e2-4720-80ee-87e3b82e8618\" (UID: \"03792630-b8e2-4720-80ee-87e3b82e8618\") " May 20 17:16:24.622481 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.622453 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03792630-b8e2-4720-80ee-87e3b82e8618-kube-api-access-8kdbj" (OuterVolumeSpecName: "kube-api-access-8kdbj") pod "03792630-b8e2-4720-80ee-87e3b82e8618" (UID: "03792630-b8e2-4720-80ee-87e3b82e8618"). InnerVolumeSpecName "kube-api-access-8kdbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:16:24.720878 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:24.720838 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kdbj\" (UniqueName: \"kubernetes.io/projected/03792630-b8e2-4720-80ee-87e3b82e8618-kube-api-access-8kdbj\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:16:25.300551 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.300447 2563 generic.go:358] "Generic (PLEG): container finished" podID="03792630-b8e2-4720-80ee-87e3b82e8618" containerID="3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a" exitCode=0 May 20 17:16:25.300551 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.300497 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vd86" May 20 17:16:25.300551 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.300532 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-8vd86" event={"ID":"03792630-b8e2-4720-80ee-87e3b82e8618","Type":"ContainerDied","Data":"3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a"} May 20 17:16:25.301130 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.300566 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-8vd86" event={"ID":"03792630-b8e2-4720-80ee-87e3b82e8618","Type":"ContainerDied","Data":"8e38eb9988aeb6a11114919918bc158d97c539d61d73a552ed8ad4ce67246cb0"} May 20 17:16:25.301130 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.300583 2563 scope.go:117] "RemoveContainer" containerID="3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a" May 20 17:16:25.309056 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.309043 2563 scope.go:117] "RemoveContainer" containerID="3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a" May 20 17:16:25.309324 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:16:25.309303 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a\": container with ID starting with 3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a not found: ID does not exist" containerID="3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a" May 20 17:16:25.309388 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.309340 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a"} err="failed to get container status \"3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a\": rpc error: code = NotFound desc = could not find container \"3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a\": container with ID starting with 3739d2980a91e3572b7b7fe4b7aff1cc25b50746b0515c3821cdb636dab98c9a not found: ID does not exist" May 20 17:16:25.317828 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.317804 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vd86"] May 20 17:16:25.321770 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:25.321750 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vd86"] May 20 17:16:26.872947 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:26.872915 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03792630-b8e2-4720-80ee-87e3b82e8618" path="/var/lib/kubelet/pods/03792630-b8e2-4720-80ee-87e3b82e8618/volumes" May 20 17:16:43.824289 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.824249 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-gh8xq"] May 20 17:16:43.824689 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.824597 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03792630-b8e2-4720-80ee-87e3b82e8618" containerName="authorino" May 20 17:16:43.824689 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.824609 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03792630-b8e2-4720-80ee-87e3b82e8618" containerName="authorino" May 20 17:16:43.824689 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.824665 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="03792630-b8e2-4720-80ee-87e3b82e8618" containerName="authorino" May 20 17:16:43.827400 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.827383 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:16:43.830238 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.830211 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 17:16:43.830373 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.830354 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-blkgm\"" May 20 17:16:43.840723 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.840695 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-gh8xq"] May 20 17:16:43.878097 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.878061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggh65\" (UniqueName: \"kubernetes.io/projected/71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e-kube-api-access-ggh65\") pod \"maas-controller-7d7cb9cb84-gh8xq\" (UID: \"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e\") " pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:16:43.979247 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.979202 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggh65\" (UniqueName: \"kubernetes.io/projected/71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e-kube-api-access-ggh65\") pod \"maas-controller-7d7cb9cb84-gh8xq\" (UID: \"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e\") " pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:16:43.988118 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:43.988092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggh65\" (UniqueName: \"kubernetes.io/projected/71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e-kube-api-access-ggh65\") pod \"maas-controller-7d7cb9cb84-gh8xq\" (UID: \"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e\") " pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:16:44.137767 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:44.137713 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:16:44.273940 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:44.273910 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-gh8xq"] May 20 17:16:44.275368 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:16:44.275325 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ad8e6d_ca32_4ba2_bd49_91bee2fbe59e.slice/crio-446a30a46b17f85cf9664fbbc4eab335a1fa300ebad9c0a0af3820e99beb9c46 WatchSource:0}: Error finding container 446a30a46b17f85cf9664fbbc4eab335a1fa300ebad9c0a0af3820e99beb9c46: Status 404 returned error can't find the container with id 446a30a46b17f85cf9664fbbc4eab335a1fa300ebad9c0a0af3820e99beb9c46 May 20 17:16:44.368925 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:44.368887 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" event={"ID":"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e","Type":"ContainerStarted","Data":"446a30a46b17f85cf9664fbbc4eab335a1fa300ebad9c0a0af3820e99beb9c46"} May 20 17:16:48.383308 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:48.383267 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" event={"ID":"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e","Type":"ContainerStarted","Data":"4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08"} May 20 17:16:48.383700 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:48.383389 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:16:48.400457 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:48.400401 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" podStartSLOduration=2.263612555 podStartE2EDuration="5.400386916s" podCreationTimestamp="2026-05-20 17:16:43 +0000 UTC" firstStartedPulling="2026-05-20 17:16:44.276813618 +0000 UTC m=+766.049836997" lastFinishedPulling="2026-05-20 17:16:47.41358799 +0000 UTC m=+769.186611358" observedRunningTime="2026-05-20 17:16:48.399904068 +0000 UTC m=+770.172927455" watchObservedRunningTime="2026-05-20 17:16:48.400386916 +0000 UTC m=+770.173410302" May 20 17:16:59.392860 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:16:59.392827 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:17:32.887305 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.887222 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt"] May 20 17:17:32.894149 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.894126 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:32.898040 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.898011 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 20 17:17:32.898040 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.898031 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xmbbj\"" May 20 17:17:32.898240 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.898064 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 20 17:17:32.898240 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.898175 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 20 17:17:32.907501 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.907428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg59z\" (UniqueName: \"kubernetes.io/projected/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-kube-api-access-gg59z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:32.907501 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.907474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:32.913889 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.907715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:32.913889 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.908062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:32.913889 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.908314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:32.913889 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.908359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:32.913889 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:32.909665 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt"] May 20 17:17:33.009505 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.009449 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.009505 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.009508 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.009776 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.009548 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gg59z\" (UniqueName: \"kubernetes.io/projected/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-kube-api-access-gg59z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.009776 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.009567 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.009776 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.009586 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.009776 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.009608 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.010038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.009985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.010038 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.010010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.010151 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.010083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.012129 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.012101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.012349 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.012332 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.019089 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.019059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg59z\" (UniqueName: \"kubernetes.io/projected/14770274-0b0c-4eb9-b3ed-aa6fab6cb608-kube-api-access-gg59z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt\" (UID: \"14770274-0b0c-4eb9-b3ed-aa6fab6cb608\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.204442 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.204344 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:33.345676 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.345651 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt"] May 20 17:17:33.348047 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:17:33.348012 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14770274_0b0c_4eb9_b3ed_aa6fab6cb608.slice/crio-08c4520988aecdddd13aede6b1296b8147f987bffdc8a7fcbeed19199f8e9a22 WatchSource:0}: Error finding container 08c4520988aecdddd13aede6b1296b8147f987bffdc8a7fcbeed19199f8e9a22: Status 404 returned error can't find the container with id 08c4520988aecdddd13aede6b1296b8147f987bffdc8a7fcbeed19199f8e9a22 May 20 17:17:33.349836 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.349820 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:17:33.540022 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:33.539932 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" event={"ID":"14770274-0b0c-4eb9-b3ed-aa6fab6cb608","Type":"ContainerStarted","Data":"08c4520988aecdddd13aede6b1296b8147f987bffdc8a7fcbeed19199f8e9a22"} May 20 17:17:38.561040 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:38.561002 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" event={"ID":"14770274-0b0c-4eb9-b3ed-aa6fab6cb608","Type":"ContainerStarted","Data":"f8ca79ac959c38d5c5ff2fb950e6a36e17cfe153fdd2d0fdf239f49b154b7df3"} May 20 17:17:44.589532 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:44.589490 2563 generic.go:358] "Generic (PLEG): container finished" podID="14770274-0b0c-4eb9-b3ed-aa6fab6cb608" containerID="f8ca79ac959c38d5c5ff2fb950e6a36e17cfe153fdd2d0fdf239f49b154b7df3" exitCode=0 May 20 17:17:44.589943 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:44.589558 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" event={"ID":"14770274-0b0c-4eb9-b3ed-aa6fab6cb608","Type":"ContainerDied","Data":"f8ca79ac959c38d5c5ff2fb950e6a36e17cfe153fdd2d0fdf239f49b154b7df3"} May 20 17:17:46.598696 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:46.598658 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" event={"ID":"14770274-0b0c-4eb9-b3ed-aa6fab6cb608","Type":"ContainerStarted","Data":"dd9838e92f4dbf48190e075e6e453f5cab513e9c0f38b56afb4e45adb59eb8e9"} May 20 17:17:46.599115 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:46.598902 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:17:46.623855 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:46.623805 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" podStartSLOduration=2.20267513 podStartE2EDuration="14.623791152s" podCreationTimestamp="2026-05-20 17:17:32 +0000 UTC" firstStartedPulling="2026-05-20 17:17:33.349963204 +0000 UTC m=+815.122986568" lastFinishedPulling="2026-05-20 17:17:45.771079227 +0000 UTC m=+827.544102590" observedRunningTime="2026-05-20 17:17:46.622450755 +0000 UTC m=+828.395474141" watchObservedRunningTime="2026-05-20 17:17:46.623791152 +0000 UTC m=+828.396814536" May 20 17:17:57.615639 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:17:57.615606 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt" May 20 17:18:36.611102 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.611071 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt"] May 20 17:18:36.614785 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.614763 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.617653 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.617633 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 20 17:18:36.624707 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.624671 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt"] May 20 17:18:36.697972 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.697936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.698126 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.698101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.698182 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.698143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b81626c0-213b-432e-8967-181381bcd264-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.698182 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.698171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.698266 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.698217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.698266 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.698247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8v85\" (UniqueName: \"kubernetes.io/projected/b81626c0-213b-432e-8967-181381bcd264-kube-api-access-m8v85\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.799518 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.799478 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.799700 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.799571 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.799700 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.799595 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b81626c0-213b-432e-8967-181381bcd264-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.799700 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.799619 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.799700 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.799638 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.799700 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.799655 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8v85\" (UniqueName: \"kubernetes.io/projected/b81626c0-213b-432e-8967-181381bcd264-kube-api-access-m8v85\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.800078 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.800048 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.800153 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.800117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.800199 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.800118 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.802022 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.802001 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b81626c0-213b-432e-8967-181381bcd264-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.802288 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.802268 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b81626c0-213b-432e-8967-181381bcd264-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.809263 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.809240 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8v85\" (UniqueName: \"kubernetes.io/projected/b81626c0-213b-432e-8967-181381bcd264-kube-api-access-m8v85\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cznrt\" (UID: \"b81626c0-213b-432e-8967-181381bcd264\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:36.948823 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:36.948722 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:37.086506 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:37.086478 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt"] May 20 17:18:37.089326 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:18:37.089302 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81626c0_213b_432e_8967_181381bcd264.slice/crio-1d6392ebe78d19e35c90d0bb9670a494286a8daac077fbb3cbc50083dfd9e8c4 WatchSource:0}: Error finding container 1d6392ebe78d19e35c90d0bb9670a494286a8daac077fbb3cbc50083dfd9e8c4: Status 404 returned error can't find the container with id 1d6392ebe78d19e35c90d0bb9670a494286a8daac077fbb3cbc50083dfd9e8c4 May 20 17:18:37.775983 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:37.775944 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" event={"ID":"b81626c0-213b-432e-8967-181381bcd264","Type":"ContainerStarted","Data":"8f3d2c15817e5128306af8ea607a1716bdf5cfdec56349a10b70549d4d3c466f"} May 20 17:18:37.775983 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:37.775983 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" event={"ID":"b81626c0-213b-432e-8967-181381bcd264","Type":"ContainerStarted","Data":"1d6392ebe78d19e35c90d0bb9670a494286a8daac077fbb3cbc50083dfd9e8c4"} May 20 17:18:46.809035 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:46.808945 2563 generic.go:358] "Generic (PLEG): container finished" podID="b81626c0-213b-432e-8967-181381bcd264" containerID="8f3d2c15817e5128306af8ea607a1716bdf5cfdec56349a10b70549d4d3c466f" exitCode=0 May 20 17:18:46.809035 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:46.809019 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" event={"ID":"b81626c0-213b-432e-8967-181381bcd264","Type":"ContainerDied","Data":"8f3d2c15817e5128306af8ea607a1716bdf5cfdec56349a10b70549d4d3c466f"} May 20 17:18:47.814819 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:47.814779 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" event={"ID":"b81626c0-213b-432e-8967-181381bcd264","Type":"ContainerStarted","Data":"e655dd147e6d619d6f7b13d280990a9536597369601f1c5a5a5e2e1a6bbe71c1"} May 20 17:18:47.815268 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:47.815028 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:47.836981 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:47.836935 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" podStartSLOduration=11.611253229 podStartE2EDuration="11.836920134s" podCreationTimestamp="2026-05-20 17:18:36 +0000 UTC" firstStartedPulling="2026-05-20 17:18:46.809667488 +0000 UTC m=+888.582690851" lastFinishedPulling="2026-05-20 17:18:47.035334379 +0000 UTC m=+888.808357756" observedRunningTime="2026-05-20 17:18:47.83480178 +0000 UTC m=+889.607825167" watchObservedRunningTime="2026-05-20 17:18:47.836920134 +0000 UTC m=+889.609943519" May 20 17:18:58.794920 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:58.794862 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:18:58.797686 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:58.797663 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:18:58.832336 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:58.832304 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cznrt" May 20 17:18:59.962302 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:59.962271 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86dd659f95-8kcx7"] May 20 17:18:59.997005 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:59.996968 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86dd659f95-8kcx7"] May 20 17:18:59.997190 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:18:59.997077 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86dd659f95-8kcx7" May 20 17:19:00.020416 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.020372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f408116b-230c-44f3-8865-95234d421c3c-tls-cert\") pod \"authorino-86dd659f95-8kcx7\" (UID: \"f408116b-230c-44f3-8865-95234d421c3c\") " pod="kuadrant-system/authorino-86dd659f95-8kcx7" May 20 17:19:00.020601 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.020464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9v2b\" (UniqueName: \"kubernetes.io/projected/f408116b-230c-44f3-8865-95234d421c3c-kube-api-access-h9v2b\") pod \"authorino-86dd659f95-8kcx7\" (UID: \"f408116b-230c-44f3-8865-95234d421c3c\") " pod="kuadrant-system/authorino-86dd659f95-8kcx7" May 20 17:19:00.120920 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.120862 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f408116b-230c-44f3-8865-95234d421c3c-tls-cert\") pod \"authorino-86dd659f95-8kcx7\" (UID: \"f408116b-230c-44f3-8865-95234d421c3c\") " pod="kuadrant-system/authorino-86dd659f95-8kcx7" May 20 17:19:00.121117 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.120927 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9v2b\" (UniqueName: \"kubernetes.io/projected/f408116b-230c-44f3-8865-95234d421c3c-kube-api-access-h9v2b\") pod \"authorino-86dd659f95-8kcx7\" (UID: \"f408116b-230c-44f3-8865-95234d421c3c\") " pod="kuadrant-system/authorino-86dd659f95-8kcx7" May 20 17:19:00.123524 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.123487 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f408116b-230c-44f3-8865-95234d421c3c-tls-cert\") pod \"authorino-86dd659f95-8kcx7\" (UID: \"f408116b-230c-44f3-8865-95234d421c3c\") " pod="kuadrant-system/authorino-86dd659f95-8kcx7" May 20 17:19:00.135383 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.135359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9v2b\" (UniqueName: \"kubernetes.io/projected/f408116b-230c-44f3-8865-95234d421c3c-kube-api-access-h9v2b\") pod \"authorino-86dd659f95-8kcx7\" (UID: \"f408116b-230c-44f3-8865-95234d421c3c\") " pod="kuadrant-system/authorino-86dd659f95-8kcx7" May 20 17:19:00.307049 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.306963 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86dd659f95-8kcx7" May 20 17:19:00.468399 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.468342 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86dd659f95-8kcx7"] May 20 17:19:00.471652 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:19:00.471623 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf408116b_230c_44f3_8865_95234d421c3c.slice/crio-d94715f933aa00d5c4448b42d7d86b8ca13a1add6a27d1ff13437e27124b0d53 WatchSource:0}: Error finding container d94715f933aa00d5c4448b42d7d86b8ca13a1add6a27d1ff13437e27124b0d53: Status 404 returned error can't find the container with id d94715f933aa00d5c4448b42d7d86b8ca13a1add6a27d1ff13437e27124b0d53 May 20 17:19:00.862169 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:00.862133 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86dd659f95-8kcx7" event={"ID":"f408116b-230c-44f3-8865-95234d421c3c","Type":"ContainerStarted","Data":"d94715f933aa00d5c4448b42d7d86b8ca13a1add6a27d1ff13437e27124b0d53"} May 20 17:19:01.867479 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:01.867426 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86dd659f95-8kcx7" event={"ID":"f408116b-230c-44f3-8865-95234d421c3c","Type":"ContainerStarted","Data":"12d9f5a43a9e97a2f4bbce5cbdcf92a22d2726a3e2b9fc4c90b534c8ee6ea148"} May 20 17:19:01.884543 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:01.884472 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-86dd659f95-8kcx7" podStartSLOduration=2.281819679 podStartE2EDuration="2.884452661s" podCreationTimestamp="2026-05-20 17:18:59 +0000 UTC" firstStartedPulling="2026-05-20 17:19:00.473001975 +0000 UTC m=+902.246025338" lastFinishedPulling="2026-05-20 17:19:01.075634956 +0000 UTC m=+902.848658320" observedRunningTime="2026-05-20 17:19:01.88318154 +0000 UTC m=+903.656204928" watchObservedRunningTime="2026-05-20 17:19:01.884452661 +0000 UTC m=+903.657476084" May 20 17:19:01.920262 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:01.920226 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56b8775646-hgdgv"] May 20 17:19:01.920482 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:01.920457 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-56b8775646-hgdgv" podUID="0a77cfb8-c7a0-4983-9ca9-14b43b5e349b" containerName="authorino" containerID="cri-o://68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882" gracePeriod=30 May 20 17:19:02.179044 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.179011 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:19:02.242713 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.242677 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-tls-cert\") pod \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\" (UID: \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\") " May 20 17:19:02.242921 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.242727 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-576kq\" (UniqueName: \"kubernetes.io/projected/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-kube-api-access-576kq\") pod \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\" (UID: \"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b\") " May 20 17:19:02.244992 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.244969 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-kube-api-access-576kq" (OuterVolumeSpecName: "kube-api-access-576kq") pod "0a77cfb8-c7a0-4983-9ca9-14b43b5e349b" (UID: "0a77cfb8-c7a0-4983-9ca9-14b43b5e349b"). InnerVolumeSpecName "kube-api-access-576kq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:19:02.253615 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.253591 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0a77cfb8-c7a0-4983-9ca9-14b43b5e349b" (UID: "0a77cfb8-c7a0-4983-9ca9-14b43b5e349b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:19:02.344215 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.344161 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-tls-cert\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:19:02.344215 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.344208 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-576kq\" (UniqueName: \"kubernetes.io/projected/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b-kube-api-access-576kq\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:19:02.873068 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.873016 2563 generic.go:358] "Generic (PLEG): container finished" podID="0a77cfb8-c7a0-4983-9ca9-14b43b5e349b" containerID="68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882" exitCode=0 May 20 17:19:02.873550 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.873130 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b8775646-hgdgv" May 20 17:19:02.874361 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.874336 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56b8775646-hgdgv" event={"ID":"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b","Type":"ContainerDied","Data":"68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882"} May 20 17:19:02.874456 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.874366 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56b8775646-hgdgv" event={"ID":"0a77cfb8-c7a0-4983-9ca9-14b43b5e349b","Type":"ContainerDied","Data":"d93cb07b3f30a1f712dbdd50d0d6a2293dc64f9ce5ca8112c821bbd70c1f2f4c"} May 20 17:19:02.874456 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.874385 2563 scope.go:117] "RemoveContainer" containerID="68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882" May 20 17:19:02.883149 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.883127 2563 scope.go:117] "RemoveContainer" containerID="68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882" May 20 17:19:02.883542 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:19:02.883516 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882\": container with ID starting with 68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882 not found: ID does not exist" containerID="68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882" May 20 17:19:02.883650 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.883551 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882"} err="failed to get container status \"68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882\": rpc error: code = NotFound desc = could not find container \"68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882\": container with ID starting with 68430436da720b312b517d58d1a11afb4b31d47c347787600d02338aabcd3882 not found: ID does not exist" May 20 17:19:02.898204 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.898167 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56b8775646-hgdgv"] May 20 17:19:02.904500 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:02.904474 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56b8775646-hgdgv"] May 20 17:19:04.872643 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:19:04.872607 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a77cfb8-c7a0-4983-9ca9-14b43b5e349b" path="/var/lib/kubelet/pods/0a77cfb8-c7a0-4983-9ca9-14b43b5e349b/volumes" May 20 17:20:27.301410 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:27.301323 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-gh8xq"] May 20 17:20:27.301977 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:27.301609 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" podUID="71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e" containerName="manager" containerID="cri-o://4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08" gracePeriod=30 May 20 17:20:27.551648 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:27.551587 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:20:27.647806 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:27.647769 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggh65\" (UniqueName: \"kubernetes.io/projected/71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e-kube-api-access-ggh65\") pod \"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e\" (UID: \"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e\") " May 20 17:20:27.650077 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:27.650051 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e-kube-api-access-ggh65" (OuterVolumeSpecName: "kube-api-access-ggh65") pod "71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e" (UID: "71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e"). InnerVolumeSpecName "kube-api-access-ggh65". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:20:27.749221 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:27.749179 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggh65\" (UniqueName: \"kubernetes.io/projected/71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e-kube-api-access-ggh65\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:20:28.170085 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.170045 2563 generic.go:358] "Generic (PLEG): container finished" podID="71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e" containerID="4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08" exitCode=0 May 20 17:20:28.170272 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.170112 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" May 20 17:20:28.170272 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.170120 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" event={"ID":"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e","Type":"ContainerDied","Data":"4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08"} May 20 17:20:28.170272 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.170154 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7cb9cb84-gh8xq" event={"ID":"71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e","Type":"ContainerDied","Data":"446a30a46b17f85cf9664fbbc4eab335a1fa300ebad9c0a0af3820e99beb9c46"} May 20 17:20:28.170272 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.170173 2563 scope.go:117] "RemoveContainer" containerID="4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08" May 20 17:20:28.179405 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.179383 2563 scope.go:117] "RemoveContainer" containerID="4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08" May 20 17:20:28.179667 ip-10-0-136-67 kubenswrapper[2563]: E0520 17:20:28.179646 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08\": container with ID starting with 4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08 not found: ID does not exist" containerID="4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08" May 20 17:20:28.179715 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.179680 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08"} err="failed to get container status \"4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08\": rpc error: code = NotFound desc = could not find container \"4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08\": container with ID starting with 4ebd86b73c5f437b7fd1dbc368a703c97ac328ab42042e34f53ec78479bd2d08 not found: ID does not exist" May 20 17:20:28.192638 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.192607 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-gh8xq"] May 20 17:20:28.196248 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.196223 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-gh8xq"] May 20 17:20:28.873514 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.873482 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e" path="/var/lib/kubelet/pods/71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e/volumes" May 20 17:20:28.953191 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.953156 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-5gfsb"] May 20 17:20:28.953520 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.953507 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e" containerName="manager" May 20 17:20:28.953571 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.953522 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e" containerName="manager" May 20 17:20:28.953571 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.953544 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a77cfb8-c7a0-4983-9ca9-14b43b5e349b" containerName="authorino" May 20 17:20:28.953571 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.953549 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a77cfb8-c7a0-4983-9ca9-14b43b5e349b" containerName="authorino" May 20 17:20:28.953665 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.953605 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a77cfb8-c7a0-4983-9ca9-14b43b5e349b" containerName="authorino" May 20 17:20:28.953665 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.953619 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="71ad8e6d-ca32-4ba2-bd49-91bee2fbe59e" containerName="manager" May 20 17:20:28.956210 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.956194 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" May 20 17:20:28.961336 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.961313 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 17:20:28.961336 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.961334 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-blkgm\"" May 20 17:20:28.969273 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:28.969246 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-5gfsb"] May 20 17:20:29.060408 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:29.060367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65gr\" (UniqueName: \"kubernetes.io/projected/b8bb88c8-a39e-4167-abab-fe9e513f59d4-kube-api-access-d65gr\") pod \"maas-controller-7d7cb9cb84-5gfsb\" (UID: \"b8bb88c8-a39e-4167-abab-fe9e513f59d4\") " pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" May 20 17:20:29.161827 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:29.161743 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d65gr\" (UniqueName: \"kubernetes.io/projected/b8bb88c8-a39e-4167-abab-fe9e513f59d4-kube-api-access-d65gr\") pod \"maas-controller-7d7cb9cb84-5gfsb\" (UID: \"b8bb88c8-a39e-4167-abab-fe9e513f59d4\") " pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" May 20 17:20:29.170094 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:29.170067 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65gr\" (UniqueName: \"kubernetes.io/projected/b8bb88c8-a39e-4167-abab-fe9e513f59d4-kube-api-access-d65gr\") pod \"maas-controller-7d7cb9cb84-5gfsb\" (UID: \"b8bb88c8-a39e-4167-abab-fe9e513f59d4\") " pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" May 20 17:20:29.266312 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:29.266269 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" May 20 17:20:29.401296 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:29.401267 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d7cb9cb84-5gfsb"] May 20 17:20:29.402418 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:20:29.402388 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8bb88c8_a39e_4167_abab_fe9e513f59d4.slice/crio-ee1c56548d279540bc1a942b925b3acf05ce3898782447f6ea3e3de1fd550221 WatchSource:0}: Error finding container ee1c56548d279540bc1a942b925b3acf05ce3898782447f6ea3e3de1fd550221: Status 404 returned error can't find the container with id ee1c56548d279540bc1a942b925b3acf05ce3898782447f6ea3e3de1fd550221 May 20 17:20:30.179946 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:30.179909 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" event={"ID":"b8bb88c8-a39e-4167-abab-fe9e513f59d4","Type":"ContainerStarted","Data":"32a1d11e6868448b7145de4e6729f1286e148da497f3db99dc4d90d3fee5e279"} May 20 17:20:30.180332 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:30.179954 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" event={"ID":"b8bb88c8-a39e-4167-abab-fe9e513f59d4","Type":"ContainerStarted","Data":"ee1c56548d279540bc1a942b925b3acf05ce3898782447f6ea3e3de1fd550221"} May 20 17:20:30.180332 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:30.180035 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" May 20 17:20:30.199023 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:30.198957 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" podStartSLOduration=1.8295889239999998 podStartE2EDuration="2.198937518s" podCreationTimestamp="2026-05-20 17:20:28 +0000 UTC" firstStartedPulling="2026-05-20 17:20:29.403759458 +0000 UTC m=+991.176782822" lastFinishedPulling="2026-05-20 17:20:29.773108042 +0000 UTC m=+991.546131416" observedRunningTime="2026-05-20 17:20:30.197376825 +0000 UTC m=+991.970400222" watchObservedRunningTime="2026-05-20 17:20:30.198937518 +0000 UTC m=+991.971960906" May 20 17:20:41.189299 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:20:41.189261 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d7cb9cb84-5gfsb" May 20 17:23:58.819486 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:23:58.819458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:23:58.825086 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:23:58.825064 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:28:58.845565 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:28:58.845536 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:28:58.851995 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:28:58.851971 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:30:00.144307 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.144267 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29654970-tdvms"] May 20 17:30:00.149735 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.149709 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" May 20 17:30:00.152267 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.152241 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ktkxb\"" May 20 17:30:00.159157 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.159123 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29654970-tdvms"] May 20 17:30:00.166235 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.166211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5fk7\" (UniqueName: \"kubernetes.io/projected/8071e84b-5fe8-4dcb-a565-5da339421425-kube-api-access-l5fk7\") pod \"maas-api-key-cleanup-29654970-tdvms\" (UID: \"8071e84b-5fe8-4dcb-a565-5da339421425\") " pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" May 20 17:30:00.267642 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.267605 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5fk7\" (UniqueName: \"kubernetes.io/projected/8071e84b-5fe8-4dcb-a565-5da339421425-kube-api-access-l5fk7\") pod \"maas-api-key-cleanup-29654970-tdvms\" (UID: \"8071e84b-5fe8-4dcb-a565-5da339421425\") " pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" May 20 17:30:00.276538 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.276509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5fk7\" (UniqueName: \"kubernetes.io/projected/8071e84b-5fe8-4dcb-a565-5da339421425-kube-api-access-l5fk7\") pod \"maas-api-key-cleanup-29654970-tdvms\" (UID: \"8071e84b-5fe8-4dcb-a565-5da339421425\") " pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" May 20 17:30:00.460820 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.460726 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" May 20 17:30:00.593985 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.593962 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29654970-tdvms"] May 20 17:30:00.596316 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:30:00.596286 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8071e84b_5fe8_4dcb_a565_5da339421425.slice/crio-d5039df140620352483e264ae1038e1375110d02b62fec28660b60fa69e9e3fe WatchSource:0}: Error finding container d5039df140620352483e264ae1038e1375110d02b62fec28660b60fa69e9e3fe: Status 404 returned error can't find the container with id d5039df140620352483e264ae1038e1375110d02b62fec28660b60fa69e9e3fe May 20 17:30:00.598083 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:00.598066 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:30:01.130829 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:01.130791 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" event={"ID":"8071e84b-5fe8-4dcb-a565-5da339421425","Type":"ContainerStarted","Data":"d5039df140620352483e264ae1038e1375110d02b62fec28660b60fa69e9e3fe"} May 20 17:30:03.138992 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:03.138944 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" event={"ID":"8071e84b-5fe8-4dcb-a565-5da339421425","Type":"ContainerStarted","Data":"9ba8349c9f69b7a44480fae671df99ba1d0aaa436ca655f74515dcc20309076a"} May 20 17:30:03.153458 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:03.153415 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" podStartSLOduration=1.0339763770000001 podStartE2EDuration="3.153402488s" podCreationTimestamp="2026-05-20 17:30:00 +0000 UTC" firstStartedPulling="2026-05-20 17:30:00.598192785 +0000 UTC m=+1562.371216148" lastFinishedPulling="2026-05-20 17:30:02.717618896 +0000 UTC m=+1564.490642259" observedRunningTime="2026-05-20 17:30:03.1533529 +0000 UTC m=+1564.926376306" watchObservedRunningTime="2026-05-20 17:30:03.153402488 +0000 UTC m=+1564.926425874" May 20 17:30:04.143596 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:04.143563 2563 generic.go:358] "Generic (PLEG): container finished" podID="8071e84b-5fe8-4dcb-a565-5da339421425" containerID="9ba8349c9f69b7a44480fae671df99ba1d0aaa436ca655f74515dcc20309076a" exitCode=0 May 20 17:30:04.143989 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:04.143654 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" event={"ID":"8071e84b-5fe8-4dcb-a565-5da339421425","Type":"ContainerDied","Data":"9ba8349c9f69b7a44480fae671df99ba1d0aaa436ca655f74515dcc20309076a"} May 20 17:30:05.278675 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:05.278651 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" May 20 17:30:05.312347 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:05.312314 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5fk7\" (UniqueName: \"kubernetes.io/projected/8071e84b-5fe8-4dcb-a565-5da339421425-kube-api-access-l5fk7\") pod \"8071e84b-5fe8-4dcb-a565-5da339421425\" (UID: \"8071e84b-5fe8-4dcb-a565-5da339421425\") " May 20 17:30:05.314594 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:05.314546 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8071e84b-5fe8-4dcb-a565-5da339421425-kube-api-access-l5fk7" (OuterVolumeSpecName: "kube-api-access-l5fk7") pod "8071e84b-5fe8-4dcb-a565-5da339421425" (UID: "8071e84b-5fe8-4dcb-a565-5da339421425"). InnerVolumeSpecName "kube-api-access-l5fk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:30:05.413196 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:05.413100 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5fk7\" (UniqueName: \"kubernetes.io/projected/8071e84b-5fe8-4dcb-a565-5da339421425-kube-api-access-l5fk7\") on node \"ip-10-0-136-67.ec2.internal\" DevicePath \"\"" May 20 17:30:06.152383 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:06.152348 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" event={"ID":"8071e84b-5fe8-4dcb-a565-5da339421425","Type":"ContainerDied","Data":"d5039df140620352483e264ae1038e1375110d02b62fec28660b60fa69e9e3fe"} May 20 17:30:06.152383 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:06.152386 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5039df140620352483e264ae1038e1375110d02b62fec28660b60fa69e9e3fe" May 20 17:30:06.152590 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:30:06.152364 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29654970-tdvms" May 20 17:33:58.871856 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:33:58.871729 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:33:58.879560 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:33:58.879537 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:38:58.896077 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:38:58.895961 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:38:58.905050 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:38:58.905031 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:41:36.818274 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:36.818190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86dd659f95-8kcx7_f408116b-230c-44f3-8865-95234d421c3c/authorino/0.log" May 20 17:41:41.723754 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:41.723715 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29654970-tdvms_8071e84b-5fe8-4dcb-a565-5da339421425/cleanup/0.log" May 20 17:41:41.845418 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:41.845382 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d7cb9cb84-5gfsb_b8bb88c8-a39e-4167-abab-fe9e513f59d4/manager/0.log" May 20 17:41:42.075120 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:42.075035 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c544869d7-f2bv2_915b54d1-bf24-4eb8-abc0-4587ead06efe/manager/0.log" May 20 17:41:42.432386 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:42.432357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-jw4d6_38eacf95-a076-4836-9d92-03423bd5da1c/postgres/0.log" May 20 17:41:43.706465 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:43.706427 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86dd659f95-8kcx7_f408116b-230c-44f3-8865-95234d421c3c/authorino/0.log" May 20 17:41:45.217226 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:45.217197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57795f5895-5gbr7_8a218409-bd71-4f51-b557-4c58db7a4a9b/kube-auth-proxy/0.log" May 20 17:41:45.340857 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:45.340816 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-kqphz_077847bf-35c6-4b2e-b458-855511d80e15/istio-proxy/0.log" May 20 17:41:46.294305 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:46.294272 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt_14770274-0b0c-4eb9-b3ed-aa6fab6cb608/main/0.log" May 20 17:41:46.302640 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:46.302614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs25jt_14770274-0b0c-4eb9-b3ed-aa6fab6cb608/storage-initializer/0.log" May 20 17:41:46.541738 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:46.541703 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-cznrt_b81626c0-213b-432e-8967-181381bcd264/storage-initializer/0.log" May 20 17:41:46.549484 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:46.549415 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-cznrt_b81626c0-213b-432e-8967-181381bcd264/main/0.log" May 20 17:41:53.882272 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:53.882235 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rqhfc_b1a7a567-5b65-492c-a89e-b33a9f27b48d/global-pull-secret-syncer/0.log" May 20 17:41:54.035802 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:54.035761 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vtgxs_18a8a61b-9730-42d0-8f02-2187b119f7a1/konnectivity-agent/0.log" May 20 17:41:54.125021 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:54.124985 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-67.ec2.internal_79afd3d7e67ee2b12b80802096c4dad2/haproxy/0.log" May 20 17:41:58.184133 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:41:58.184093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86dd659f95-8kcx7_f408116b-230c-44f3-8865-95234d421c3c/authorino/0.log" May 20 17:42:00.147814 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.147778 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-t2h2q_bfc151c4-d9f2-47da-b3c1-56e2cca5cb3e/cluster-monitoring-operator/0.log" May 20 17:42:00.281022 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.280986 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-nwxdp_1fa85426-9a91-4d52-9b2c-796cc1c24941/monitoring-plugin/0.log" May 20 17:42:00.320321 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.320292 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hc6gs_a7c23f04-987a-4bff-ae86-32303f4e8151/node-exporter/0.log" May 20 17:42:00.338967 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.338938 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hc6gs_a7c23f04-987a-4bff-ae86-32303f4e8151/kube-rbac-proxy/0.log" May 20 17:42:00.358628 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.358601 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hc6gs_a7c23f04-987a-4bff-ae86-32303f4e8151/init-textfile/0.log" May 20 17:42:00.626089 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.626057 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6baa2139-924b-4ded-b7a1-728eee09610c/prometheus/0.log" May 20 17:42:00.648309 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.648281 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6baa2139-924b-4ded-b7a1-728eee09610c/config-reloader/0.log" May 20 17:42:00.671095 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.671068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6baa2139-924b-4ded-b7a1-728eee09610c/thanos-sidecar/0.log" May 20 17:42:00.692420 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.692394 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6baa2139-924b-4ded-b7a1-728eee09610c/kube-rbac-proxy-web/0.log" May 20 17:42:00.714211 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.714176 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6baa2139-924b-4ded-b7a1-728eee09610c/kube-rbac-proxy/0.log" May 20 17:42:00.735861 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.735834 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6baa2139-924b-4ded-b7a1-728eee09610c/kube-rbac-proxy-thanos/0.log" May 20 17:42:00.759389 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.759357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6baa2139-924b-4ded-b7a1-728eee09610c/init-config-reloader/0.log" May 20 17:42:00.796697 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.796600 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-dfxpr_9bb75ed1-2ff6-4008-bc60-5f28d329f686/prometheus-operator/0.log" May 20 17:42:00.814503 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.814469 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-dfxpr_9bb75ed1-2ff6-4008-bc60-5f28d329f686/kube-rbac-proxy/0.log" May 20 17:42:00.838380 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:00.838346 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-l578q_22ac31c7-4ded-4c4c-8d24-2d0dbc8695c1/prometheus-operator-admission-webhook/0.log" May 20 17:42:02.343766 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.343727 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn"] May 20 17:42:02.344199 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.344089 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8071e84b-5fe8-4dcb-a565-5da339421425" containerName="cleanup" May 20 17:42:02.344199 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.344100 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8071e84b-5fe8-4dcb-a565-5da339421425" containerName="cleanup" May 20 17:42:02.344199 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.344173 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="8071e84b-5fe8-4dcb-a565-5da339421425" containerName="cleanup" May 20 17:42:02.347333 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.347311 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.350064 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.350037 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wkmlc\"/\"default-dockercfg-jg2mz\"" May 20 17:42:02.350204 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.350072 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wkmlc\"/\"openshift-service-ca.crt\"" May 20 17:42:02.350882 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.350851 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wkmlc\"/\"kube-root-ca.crt\"" May 20 17:42:02.356964 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.356944 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn"] May 20 17:42:02.400821 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.400785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-lib-modules\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.401030 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.400838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-sys\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.401030 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.400954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkqdn\" (UniqueName: \"kubernetes.io/projected/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-kube-api-access-gkqdn\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.401030 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.400983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-proc\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.401175 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.401054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-podres\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.501768 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.501726 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkqdn\" (UniqueName: \"kubernetes.io/projected/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-kube-api-access-gkqdn\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.501768 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.501767 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-proc\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.502052 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.501845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-proc\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.502052 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.501911 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-podres\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.502052 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.501960 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-lib-modules\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.502052 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.501997 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-sys\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.502223 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.502064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-podres\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.502223 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.502067 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-sys\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.502223 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.502112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-lib-modules\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.509564 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.509536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkqdn\" (UniqueName: \"kubernetes.io/projected/e8d61b41-4dd9-4e37-bfaa-af6c873abd72-kube-api-access-gkqdn\") pod \"perf-node-gather-daemonset-tz7bn\" (UID: \"e8d61b41-4dd9-4e37-bfaa-af6c873abd72\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.659183 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.659088 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:02.741705 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.741474 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/2.log" May 20 17:42:02.753292 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.753263 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-bkxs2_d65c6ed2-d28c-4dab-b193-fe8e9088861c/console-operator/3.log" May 20 17:42:02.791212 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.791127 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn"] May 20 17:42:02.793588 ip-10-0-136-67 kubenswrapper[2563]: W0520 17:42:02.793561 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode8d61b41_4dd9_4e37_bfaa_af6c873abd72.slice/crio-a047d76d1cbd02e019642aa8b995116f69a1b12be3d25f607fac4372b00d1371 WatchSource:0}: Error finding container a047d76d1cbd02e019642aa8b995116f69a1b12be3d25f607fac4372b00d1371: Status 404 returned error can't find the container with id a047d76d1cbd02e019642aa8b995116f69a1b12be3d25f607fac4372b00d1371 May 20 17:42:02.795201 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:02.795186 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:42:03.276333 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:03.276296 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-n4248_ccdfcfa3-dd86-4767-af21-02a2209c8d6e/download-server/0.log" May 20 17:42:03.633687 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:03.633650 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" event={"ID":"e8d61b41-4dd9-4e37-bfaa-af6c873abd72","Type":"ContainerStarted","Data":"cb1be22f8cb59b5c8c88742aa675794f0d3b9fca9e85cdfb893863719fdd7bed"} May 20 17:42:03.633687 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:03.633690 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" event={"ID":"e8d61b41-4dd9-4e37-bfaa-af6c873abd72","Type":"ContainerStarted","Data":"a047d76d1cbd02e019642aa8b995116f69a1b12be3d25f607fac4372b00d1371"} May 20 17:42:03.634187 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:03.633755 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:03.651118 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:03.651069 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" podStartSLOduration=1.651054168 podStartE2EDuration="1.651054168s" podCreationTimestamp="2026-05-20 17:42:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:42:03.649017765 +0000 UTC m=+2285.422041150" watchObservedRunningTime="2026-05-20 17:42:03.651054168 +0000 UTC m=+2285.424077553" May 20 17:42:03.773315 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:03.773282 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-sk6pt_a7c132d6-9fc0-49f2-a5ed-79b4fb48caf1/volume-data-source-validator/0.log" May 20 17:42:04.599418 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:04.599389 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4vxws_9a259a15-bf9c-4bd2-87fb-08aa32422e37/dns/0.log" May 20 17:42:04.619146 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:04.619108 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4vxws_9a259a15-bf9c-4bd2-87fb-08aa32422e37/kube-rbac-proxy/0.log" May 20 17:42:04.731282 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:04.731240 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4prt_2ac8bbc9-e535-4830-9fc3-afa16269a6f0/dns-node-resolver/0.log" May 20 17:42:05.295491 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:05.295457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wm24m_231e130d-9265-45f0-82fd-7306d6440b07/node-ca/0.log" May 20 17:42:06.239297 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:06.239266 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57795f5895-5gbr7_8a218409-bd71-4f51-b557-4c58db7a4a9b/kube-auth-proxy/0.log" May 20 17:42:06.336565 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:06.336527 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-kqphz_077847bf-35c6-4b2e-b458-855511d80e15/istio-proxy/0.log" May 20 17:42:06.941468 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:06.941433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5jtr8_91924491-1822-4ff1-8759-17da34aeffb6/serve-healthcheck-canary/0.log" May 20 17:42:07.431585 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:07.431548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-6sfd6_fdaa5d89-3dfc-44ed-b29a-cc95026827d9/insights-operator/0.log" May 20 17:42:07.432070 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:07.431779 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-6sfd6_fdaa5d89-3dfc-44ed-b29a-cc95026827d9/insights-operator/1.log" May 20 17:42:07.451119 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:07.451093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnfdb_c30dd71b-6990-44c7-bbf7-37ae0763c8bc/kube-rbac-proxy/0.log" May 20 17:42:07.470441 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:07.470409 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnfdb_c30dd71b-6990-44c7-bbf7-37ae0763c8bc/exporter/0.log" May 20 17:42:07.492037 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:07.492014 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnfdb_c30dd71b-6990-44c7-bbf7-37ae0763c8bc/extractor/0.log" May 20 17:42:09.594051 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:09.594009 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29654970-tdvms_8071e84b-5fe8-4dcb-a565-5da339421425/cleanup/0.log" May 20 17:42:09.649805 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:09.649765 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-tz7bn" May 20 17:42:09.683529 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:09.683491 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d7cb9cb84-5gfsb_b8bb88c8-a39e-4167-abab-fe9e513f59d4/manager/0.log" May 20 17:42:09.738808 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:09.738771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c544869d7-f2bv2_915b54d1-bf24-4eb8-abc0-4587ead06efe/manager/0.log" May 20 17:42:09.828019 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:09.827981 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-jw4d6_38eacf95-a076-4836-9d92-03423bd5da1c/postgres/0.log" May 20 17:42:11.086183 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:11.086092 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7455d58f8d-2s8pl_8f8ca3db-60d9-45c8-85c9-9f90b276f2ee/manager/0.log" May 20 17:42:15.477879 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:15.477827 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-mkz9w_32973a7d-9edc-42d0-9a71-5c652ace1001/migrator/0.log" May 20 17:42:15.496862 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:15.496829 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-mkz9w_32973a7d-9edc-42d0-9a71-5c652ace1001/graceful-termination/0.log" May 20 17:42:15.872132 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:15.872096 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-fcqrb_7b07d22d-9ba8-473c-a06b-20232e88379e/kube-storage-version-migrator-operator/1.log" May 20 17:42:15.874228 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:15.874200 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-fcqrb_7b07d22d-9ba8-473c-a06b-20232e88379e/kube-storage-version-migrator-operator/0.log" May 20 17:42:16.865974 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:16.865945 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4fbsw_94992ae1-f9df-4d7c-adcf-ab2ddb57770c/kube-multus/0.log" May 20 17:42:16.887736 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:16.887703 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdk7_5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8/kube-multus-additional-cni-plugins/0.log" May 20 17:42:16.909718 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:16.909683 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdk7_5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8/egress-router-binary-copy/0.log" May 20 17:42:16.932714 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:16.932688 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdk7_5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8/cni-plugins/0.log" May 20 17:42:16.958118 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:16.958090 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdk7_5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8/bond-cni-plugin/0.log" May 20 17:42:16.978333 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:16.978304 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdk7_5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8/routeoverride-cni/0.log" May 20 17:42:16.998199 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:16.998174 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdk7_5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8/whereabouts-cni-bincopy/0.log" May 20 17:42:17.026198 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:17.026173 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdk7_5ef3c1a9-f3c0-4adb-ae2d-d3368164b4a8/whereabouts-cni/0.log" May 20 17:42:17.707811 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:17.707783 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gs5mr_e6b2eeb9-1b45-4073-a920-6e63f19c9384/network-metrics-daemon/0.log" May 20 17:42:17.730110 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:17.730085 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gs5mr_e6b2eeb9-1b45-4073-a920-6e63f19c9384/kube-rbac-proxy/0.log" May 20 17:42:19.023247 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:19.023212 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm5q4_a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe/ovn-controller/0.log" May 20 17:42:19.059510 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:19.059474 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm5q4_a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe/ovn-acl-logging/0.log" May 20 17:42:19.083036 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:19.083000 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm5q4_a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe/kube-rbac-proxy-node/0.log" May 20 17:42:19.106360 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:19.106333 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm5q4_a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe/kube-rbac-proxy-ovn-metrics/0.log" May 20 17:42:19.123820 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:19.123795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm5q4_a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe/northd/0.log" May 20 17:42:19.148034 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:19.148002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm5q4_a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe/nbdb/0.log" May 20 17:42:19.169095 ip-10-0-136-67 kubenswrapper[2563]: I0520 17:42:19.169062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm5q4_a2d7195f-fefe-44ef-aa7f-ccce8eed9ffe/sbdb/0.log"