May 27 01:58:54.777730 ip-10-0-142-84 systemd[1]: Starting Kubernetes Kubelet...
May 27 01:58:55.300663 ip-10-0-142-84 kubenswrapper[2546]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 01:58:55.300663 ip-10-0-142-84 kubenswrapper[2546]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 01:58:55.300663 ip-10-0-142-84 kubenswrapper[2546]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 01:58:55.301165 ip-10-0-142-84 kubenswrapper[2546]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 01:58:55.301165 ip-10-0-142-84 kubenswrapper[2546]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 01:58:55.302878 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.302711    2546 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 01:58:55.305519 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305505    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:58:55.305519 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305520    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305524    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305527    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305530    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305533    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305535    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305538    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305540    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305543    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305545    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305548    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305550    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305553    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305555    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305563    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305565    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305568    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305570    2546 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305573    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305575    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:58:55.305585 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305578    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305580    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305583    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305585    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305588    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305591    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305594    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305596    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305599    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305602    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305604    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305607    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305610    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305612    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305615    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305617    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305620    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305623    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305625    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305627    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:58:55.306053 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305630    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305633    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305635    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305638    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305640    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305643    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305645    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305647    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305650    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305652    2546 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305655    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305657    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305659    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305662    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305666    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305670    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305674    2546 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305677    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305680    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:58:55.306785 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305683    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305685    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305688    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305690    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305694    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305697    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305699    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305702    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305704    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305707    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305711    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305714    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305717    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305720    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305723    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305725    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305728    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305731    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305733    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305736    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:58:55.307388 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305738    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305741    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305743    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305745    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305748    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.305750    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307374    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307392    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307396    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307400    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307496    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307501    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307505    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307507    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307511    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307514    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307517    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307520    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307523    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307525    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:58:55.307949 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307528    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307531    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307533    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307536    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307540    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307545    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307548    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307551    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307554    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307557    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307559    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307562    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307565    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307567    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307570    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307573    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307575    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307578    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307580    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307585    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:58:55.308453 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307587    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307590    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307593    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307595    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307597    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307603    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307607    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307610    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307613    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307616    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307618    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307621    2546 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307623    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307626    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307628    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307630    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307633    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307635    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307638    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307640    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:58:55.308972 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307643    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307645    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307648    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307650    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307653    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307656    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307658    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307661    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307663    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307665    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307668    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307671    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307674    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307676    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307679    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307681    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307684    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307686    2546 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307689    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307691    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:58:55.309495 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307693    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307696    2546 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307698    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307701    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307703    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307707    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307709    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307712    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307714    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307716    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307719    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.307721    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309179    2546 flags.go:64] FLAG: --address="0.0.0.0"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309188    2546 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309194    2546 flags.go:64] FLAG: --anonymous-auth="true"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309201    2546 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309205    2546 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309208    2546 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309212    2546 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309216    2546 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309219    2546 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 01:58:55.309985 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309222    2546 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309226    2546 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309230    2546 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309234    2546 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309237    2546 flags.go:64] FLAG: --cgroup-root=""
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309239    2546 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309242    2546 flags.go:64] FLAG: --client-ca-file=""
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309245    2546 flags.go:64] FLAG: --cloud-config=""
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309248    2546 flags.go:64] FLAG: --cloud-provider="external"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309251    2546 flags.go:64] FLAG: --cluster-dns="[]"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309255    2546 flags.go:64] FLAG: --cluster-domain=""
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309258    2546 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309261    2546 flags.go:64] FLAG: --config-dir=""
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309264    2546 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309267    2546 flags.go:64] FLAG: --container-log-max-files="5"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309271    2546 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309274    2546 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309277    2546 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309280    2546 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309283    2546 flags.go:64] FLAG: --contention-profiling="false"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309286    2546 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309289    2546 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309292    2546 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309295    2546 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309299    2546 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 01:58:55.310523 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309302    2546 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309305    2546 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309307    2546 flags.go:64] FLAG: --enable-load-reader="false"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309310    2546 flags.go:64] FLAG: --enable-server="true"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309313    2546 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309317    2546 flags.go:64] FLAG: --event-burst="100"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309320    2546 flags.go:64] FLAG: --event-qps="50"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309323    2546 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309326    2546 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309330    2546 flags.go:64] FLAG: --eviction-hard=""
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309334    2546 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309336    2546 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309339    2546 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309342    2546 flags.go:64] FLAG: --eviction-soft=""
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309360    2546 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309365    2546 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309370    2546 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309374    2546 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309377    2546 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309380    2546 flags.go:64] FLAG: --fail-swap-on="true"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309383    2546 flags.go:64] FLAG: --feature-gates=""
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309387    2546 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309390    2546 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309393    2546 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309397    2546 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309400    2546 flags.go:64] FLAG: --healthz-port="10248"
May 27 01:58:55.311141 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309403    2546 flags.go:64] FLAG: --help="false"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309406    2546 flags.go:64] FLAG: --hostname-override="ip-10-0-142-84.ec2.internal"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309409    2546 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309412    2546 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309414    2546 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309417    2546 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309421    2546 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309423    2546 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309426    2546 flags.go:64] FLAG: --image-service-endpoint=""
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309429    2546 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309431    2546 flags.go:64] FLAG: --kube-api-burst="100"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309434    2546 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309437    2546 flags.go:64] FLAG: --kube-api-qps="50"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309440    2546 flags.go:64] FLAG: --kube-reserved=""
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309442    2546 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309446    2546 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309449    2546 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309452    2546 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309455    2546 flags.go:64] FLAG: --lock-file=""
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309457    2546 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309460    2546 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309463    2546 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309468    2546 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 01:58:55.311812 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309471    2546 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309474    2546 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309477    2546 flags.go:64] FLAG: --logging-format="text"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309479    2546 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309482    2546 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309485    2546 flags.go:64] FLAG: --manifest-url=""
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309488    2546 flags.go:64] FLAG: --manifest-url-header=""
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309492    2546 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309496    2546 flags.go:64] FLAG: --max-open-files="1000000"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309500    2546 flags.go:64] FLAG: --max-pods="110"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309503    2546 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309506    2546 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309509    2546 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309512    2546 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309515    2546 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309517    2546 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309520    2546 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309527    2546 flags.go:64] FLAG: --node-status-max-images="50"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309530    2546 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309533    2546 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309536    2546 flags.go:64] FLAG: --pod-cidr=""
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309539    2546 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309544    2546 flags.go:64] FLAG: --pod-manifest-path=""
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309547    2546 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 01:58:55.312402 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309550    2546 flags.go:64] FLAG: --pods-per-core="0"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309553    2546 flags.go:64] FLAG: --port="10250"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309556    2546 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309559    2546 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09811631b81631dac"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309563    2546 flags.go:64] FLAG: --qos-reserved=""
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309566    2546 flags.go:64] FLAG: --read-only-port="10255"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309568    2546 flags.go:64] FLAG: --register-node="true"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309571    2546 flags.go:64] FLAG: --register-schedulable="true"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309574    2546 flags.go:64] FLAG: --register-with-taints=""
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309578    2546 flags.go:64] FLAG: --registry-burst="10"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309581    2546 flags.go:64] FLAG: --registry-qps="5"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309584    2546 flags.go:64] FLAG: --reserved-cpus=""
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309587    2546 flags.go:64] FLAG: --reserved-memory=""
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309590    2546 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309593    2546 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309596    2546 flags.go:64] FLAG: --rotate-certificates="false"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309599    2546 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309602    2546 flags.go:64] FLAG: --runonce="false"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309605    2546 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309608    2546 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309611    2546 flags.go:64] FLAG: --seccomp-default="false"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309613    2546 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309616    2546 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309619    2546 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309622    2546 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309625    2546 flags.go:64] FLAG: --storage-driver-password="root"
May 27 01:58:55.313016 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309628    2546 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309630    2546 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309633    2546 flags.go:64] FLAG: --storage-driver-user="root"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309636    2546 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309639    2546 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309641    2546 flags.go:64] FLAG: --system-cgroups=""
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309644    2546 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309650    2546 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309653    2546 flags.go:64] FLAG: --tls-cert-file=""
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309656    2546 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309660    2546 flags.go:64] FLAG: --tls-min-version=""
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309663    2546 flags.go:64] FLAG: --tls-private-key-file=""
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309665    2546 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309668    2546 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309671    2546 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309674    2546 flags.go:64] FLAG: --v="2"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309678    2546 flags.go:64] FLAG: --version="false"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309681    2546 flags.go:64] FLAG: --vmodule=""
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309685    2546 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.309688    2546 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309792    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309797    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309800    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309803    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:58:55.313661 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309806    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309808    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309811    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309813    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309816    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309819    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309821    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309823    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309827    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309830    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309833    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309836    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309839    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309842    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309846    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309850    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309852    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309855    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309857    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309859    2546 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:58:55.314221 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309862    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309864    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309866    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309869    2546 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309872    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309874    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309876    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309879    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309882    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309884    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309886    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309889    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309891    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309894    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309896    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309899    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309901    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309903    2546 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309906    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309909    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:58:55.314827 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309911    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309914    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309916    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309919    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309921    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309924    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309930    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309933    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309935    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309938    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309940    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309943    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309945    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309947    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309950    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309952    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309954    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309957    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309959    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:58:55.315314 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309962    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309964    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309966    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309969    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309971    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309973    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309976    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309978    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309981    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309983    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309987    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309990    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309993    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309995    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.309998    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.310001    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.310003    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.310005    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.310008    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:58:55.315839 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.310011    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:58:55.316319 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.310014    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:58:55.316319 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.310017    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:58:55.316319 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.310019    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:58:55.316319 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.310637    2546 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 01:58:55.316754 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.316734    2546 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 01:58:55.316788 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.316755    2546 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 01:58:55.316817 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316802    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:58:55.316817 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316807    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:58:55.316817 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316810    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:58:55.316817 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316813    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:58:55.316817 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316816    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:58:55.316817 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316819    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316822    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316825    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316828    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316831    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316833    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316836    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316839    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316842    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316845    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316847    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316850    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316852    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316855    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316858    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316860    2546 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316863    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316865    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316867    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316870    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:58:55.316976 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316872    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316874    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316877    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316879    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316882    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316885    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316888    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316890    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316893    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316895    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316898    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316902    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316906    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316909    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316913    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316916    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316918    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316921    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316923    2546 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316926    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:58:55.317462 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316929    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316931    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316934    2546 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316936    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316939    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316941    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316944    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316946    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316949    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316951    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316954    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316956    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316958    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316961    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316963    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316965    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316968    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316971    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316973    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:58:55.317963 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316977    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316979    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316982    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316985    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316988    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316990    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316993    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316995    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.316998    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317000    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317003    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317005    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317009    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317012    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317015    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317018    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317020    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317023    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317026    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:58:55.318459 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317029    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317031    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317034    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.317039    2546 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317127    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317132    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317135    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317137    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317140    2546 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317143    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317146    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317149    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317152    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317155    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317158    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317161    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:58:55.318912 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317163    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317165    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317168    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317170    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317173    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317176    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317178    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317181    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317183    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317186    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317188    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317191    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317193    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317196    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317198    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317201    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317203    2546 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317205    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317207    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317210    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:58:55.319301 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317213    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317215    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317217    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317220    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317222    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317224    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317227    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317229    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317232    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317234    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317237    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317240    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317243    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317245    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317247    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317250    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317253    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317256    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317259    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:58:55.319822 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317261    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317263    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317266    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317268    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317271    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317273    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317275    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317278    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317280    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317284    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317287    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317290    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317293    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317295    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317298    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317301    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317303    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317306    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317308    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317311    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:58:55.320278 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317313    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317316    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317318    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317321    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317323    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317326    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317329    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317331    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317333    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317336    2546 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317339    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317341    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317361    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317364    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:55.317366    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:58:55.320788 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.317371    2546 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 01:58:55.321155 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.318097    2546 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 01:58:55.322910 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.322896    2546 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 01:58:55.323942 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.323931    2546 server.go:1019] "Starting client certificate rotation"
May 27 01:58:55.324047 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.324032    2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 01:58:55.324077 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.324070    2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 01:58:55.356984 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.356971    2546 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 01:58:55.358982 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.358966    2546 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 01:58:55.381211 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.381191    2546 log.go:25] "Validated CRI v1 runtime API"
May 27 01:58:55.386475 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.386461    2546 log.go:25] "Validated CRI v1 image API"
May 27 01:58:55.387803 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.387786    2546 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 01:58:55.393381 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.393361    2546 fs.go:135] Filesystem UUIDs: map[327eff1b-d9ae-4bb0-813d-f6c1e4f9be41:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c307f583-831b-407e-a0a8-d5d9ac9d222d:/dev/nvme0n1p3]
May 27 01:58:55.393443 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.393381    2546 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 01:58:55.397549 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.397452    2546 manager.go:217] Machine: {Timestamp:2026-05-27 01:58:55.396941114 +0000 UTC m=+0.481279389 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101152 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2319d7a151c08f0d6c646ffcc6eae6 SystemUUID:ec2319d7-a151-c08f-0d6c-646ffcc6eae6 BootID:94f51246-190d-4a92-a58f-0e64e9e3cb27 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:80:47:3f:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:80:47:3f:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:64:5a:69:e5:59 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 01:58:55.398335 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.398325    2546 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 01:58:55.398446 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.398434    2546 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 01:58:55.400580 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.400559    2546 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 01:58:55.400707 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.400584    2546 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 01:58:55.400752 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.400716    2546 topology_manager.go:138] "Creating topology manager with none policy"
May 27 01:58:55.400752 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.400724    2546 container_manager_linux.go:306] "Creating device plugin manager"
May 27 01:58:55.400752 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.400731    2546 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 01:58:55.401672 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.401663    2546 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 01:58:55.402254 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.402239    2546 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 01:58:55.403097 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.403086    2546 state_mem.go:36] "Initialized new in-memory state store"
May 27 01:58:55.403201 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.403192    2546 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 01:58:55.406253 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.406243    2546 kubelet.go:491] "Attempting to sync node with API server"
May 27 01:58:55.406290 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.406257    2546 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 01:58:55.406290 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.406270    2546 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 01:58:55.406290 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.406279    2546 kubelet.go:397] "Adding apiserver pod source"
May 27 01:58:55.406290 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.406287    2546 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 01:58:55.407445 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.407434    2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 01:58:55.407481 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.407452    2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 01:58:55.413358 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.413325    2546 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 01:58:55.415360 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.415331    2546 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 01:58:55.416266 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416246    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 01:58:55.416266 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416264    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 01:58:55.416266 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416269    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 01:58:55.416266 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416275    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 01:58:55.416563 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416283    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 01:58:55.416563 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416289    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 01:58:55.416563 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416294    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 01:58:55.416563 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416299    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 01:58:55.416563 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416305    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 01:58:55.416563 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416310    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 01:58:55.416563 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416330    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 01:58:55.416853 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.416715    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 01:58:55.417628 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.417617    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 01:58:55.417679 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.417669    2546 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 01:58:55.420729 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.420715    2546 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 01:58:55.420791 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.420755    2546 server.go:1295] "Started kubelet"
May 27 01:58:55.420879 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.420849    2546 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 01:58:55.421054 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.420841    2546 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 01:58:55.421133 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.421066    2546 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 01:58:55.421387 ip-10-0-142-84 systemd[1]: Started Kubernetes Kubelet.
May 27 01:58:55.423249 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.422551    2546 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 01:58:55.423249 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.423159    2546 server.go:317] "Adding debug handlers to kubelet server"
May 27 01:58:55.429370 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.429331    2546 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 01:58:55.429503 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.429486    2546 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 01:58:55.430443 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.430416    2546 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 01:58:55.430541 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.430517    2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mh4vr"
May 27 01:58:55.435442 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.435420    2546 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 01:58:55.436631 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.433480    2546 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-84.ec2.internal.18b3498a253fc602  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-84.ec2.internal,UID:ip-10-0-142-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-84.ec2.internal,},FirstTimestamp:2026-05-27 01:58:55.420728834 +0000 UTC m=+0.505067107,LastTimestamp:2026-05-27 01:58:55.420728834 +0000 UTC m=+0.505067107,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-84.ec2.internal,}"
May 27 01:58:55.437525 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.437503    2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 01:58:55.438154 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.438137    2546 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 01:58:55.438286 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.438271    2546 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 01:58:55.438373 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.438287    2546 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 01:58:55.438450 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.438437    2546 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 01:58:55.438541 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.438523    2546 reconstruct.go:97] "Volume reconstruction finished"
May 27 01:58:55.438541 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.438536    2546 reconciler.go:26] "Reconciler: start to sync state"
May 27 01:58:55.438677 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.438607    2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mh4vr"
May 27 01:58:55.439142 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.439120    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:55.439227 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.439213    2546 factory.go:153] Registering CRI-O factory
May 27 01:58:55.439271 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.439233    2546 factory.go:223] Registration of the crio container factory successfully
May 27 01:58:55.439306 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.439280    2546 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 01:58:55.439306 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.439289    2546 factory.go:55] Registering systemd factory
May 27 01:58:55.439306 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.439295    2546 factory.go:223] Registration of the systemd container factory successfully
May 27 01:58:55.439436 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.439311    2546 factory.go:103] Registering Raw factory
May 27 01:58:55.439436 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.439325    2546 manager.go:1196] Started watching for new ooms in manager
May 27 01:58:55.439808 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.439793    2546 manager.go:319] Starting recovery of all containers
May 27 01:58:55.449299 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.449284    2546 manager.go:324] Recovery completed
May 27 01:58:55.450122 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.450104    2546 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:58:55.453100 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.453083    2546 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-84.ec2.internal\" not found" node="ip-10-0-142-84.ec2.internal"
May 27 01:58:55.453316 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.453304    2546 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:58:55.455183 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.455167    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:58:55.455253 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.455202    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:58:55.455253 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.455218    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
May 27 01:58:55.455731 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.455717    2546 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 01:58:55.455731 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.455730    2546 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 01:58:55.455854 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.455750    2546 state_mem.go:36] "Initialized new in-memory state store"
May 27 01:58:55.459304 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.459289    2546 policy_none.go:49] "None policy: Start"
May 27 01:58:55.459389 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.459309    2546 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 01:58:55.459389 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.459322    2546 state_mem.go:35] "Initializing new in-memory state store"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.499437    2546 manager.go:341] "Starting Device Plugin manager"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.499480    2546 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.499489    2546 server.go:85] "Starting device plugin registration server"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.499665    2546 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.499677    2546 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.499786    2546 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.499855    2546 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.499863    2546 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.500490    2546 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 01:58:55.521841 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.500523    2546 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:55.541199 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.541169    2546 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 01:58:55.543178 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.543152    2546 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 01:58:55.543178 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.543180    2546 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 01:58:55.543320 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.543199    2546 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 01:58:55.543320 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.543208    2546 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 01:58:55.543320 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.543286    2546 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 01:58:55.546866 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.546851    2546 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:58:55.600793 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.600751    2546 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:58:55.601583 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.601568    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:58:55.601665 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.601588    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:58:55.601665 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.601598    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
May 27 01:58:55.601665 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.601616    2546 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-84.ec2.internal"
May 27 01:58:55.609670 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.609656    2546 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-84.ec2.internal"
May 27 01:58:55.609714 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.609676    2546 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-84.ec2.internal\": node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:55.625624 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.625603    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:55.643775 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.643749    2546 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"]
May 27 01:58:55.643862 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.643820    2546 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:58:55.646007 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.645990    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:58:55.646071 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.646020    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:58:55.646071 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.646031    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
May 27 01:58:55.647187 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647175    2546 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:58:55.647336 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647322    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.647435 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647363    2546 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:58:55.647858 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647841    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:58:55.647858 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647851    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:58:55.648001 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647871    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:58:55.648001 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647876    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:58:55.648001 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647885    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
May 27 01:58:55.648001 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.647890    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
May 27 01:58:55.648991 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.648974    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.649079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.649004    2546 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:58:55.649690 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.649676    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:58:55.649690 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.649700    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:58:55.649836 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.649714    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
May 27 01:58:55.663944 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.663924    2546 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-84.ec2.internal\" not found" node="ip-10-0-142-84.ec2.internal"
May 27 01:58:55.667624 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.667608    2546 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-84.ec2.internal\" not found" node="ip-10-0-142-84.ec2.internal"
May 27 01:58:55.726671 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.726654    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:55.740434 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.740412    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fc9d2da8a761350521ba6c477b33b3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"5fc9d2da8a761350521ba6c477b33b3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.740482 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.740441    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fc9d2da8a761350521ba6c477b33b3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"5fc9d2da8a761350521ba6c477b33b3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.740482 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.740459    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1da4437bdc14517242770227d1e0a59-config\") pod \"kube-apiserver-proxy-ip-10-0-142-84.ec2.internal\" (UID: \"f1da4437bdc14517242770227d1e0a59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.827425 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.827405    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:55.840768 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.840737    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fc9d2da8a761350521ba6c477b33b3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"5fc9d2da8a761350521ba6c477b33b3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.840824 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.840784    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fc9d2da8a761350521ba6c477b33b3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"5fc9d2da8a761350521ba6c477b33b3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.840824 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.840802    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1da4437bdc14517242770227d1e0a59-config\") pod \"kube-apiserver-proxy-ip-10-0-142-84.ec2.internal\" (UID: \"f1da4437bdc14517242770227d1e0a59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.840824 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.840802    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fc9d2da8a761350521ba6c477b33b3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"5fc9d2da8a761350521ba6c477b33b3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.840914 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.840829    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1da4437bdc14517242770227d1e0a59-config\") pod \"kube-apiserver-proxy-ip-10-0-142-84.ec2.internal\" (UID: \"f1da4437bdc14517242770227d1e0a59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.840914 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.840851    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fc9d2da8a761350521ba6c477b33b3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"5fc9d2da8a761350521ba6c477b33b3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.928166 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:55.928122    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:55.967583 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.967553    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:55.970320 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:55.970302    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
May 27 01:58:56.028958 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:56.028934    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:56.129427 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:56.129399    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:56.229916 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:56.229858    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:56.307913 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.307874    2546 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:58:56.324044 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.324021    2546 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 01:58:56.324194 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.324165    2546 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 01:58:56.324293 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.324218    2546 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 01:58:56.324293 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.324218    2546 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 01:58:56.330157 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:56.330138    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:56.430202 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:56.430179    2546 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
May 27 01:58:56.438118 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.438092    2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 01:58:56.440916 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.440875    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 01:53:55 +0000 UTC" deadline="2028-03-07 06:09:31.345694762 +0000 UTC"
May 27 01:58:56.440989 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.440917    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15604h10m34.904781655s"
May 27 01:58:56.451244 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.451222    2546 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 01:58:56.473699 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.473569    2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-prcx9"
May 27 01:58:56.477051 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:56.477014    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc9d2da8a761350521ba6c477b33b3c.slice/crio-f8cc753c3703ad811c4aac9c76a2dad10648bdc9cb0f3f2fd201b2a5605f8c77 WatchSource:0}: Error finding container f8cc753c3703ad811c4aac9c76a2dad10648bdc9cb0f3f2fd201b2a5605f8c77: Status 404 returned error can't find the container with id f8cc753c3703ad811c4aac9c76a2dad10648bdc9cb0f3f2fd201b2a5605f8c77
May 27 01:58:56.477390 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:56.477368    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1da4437bdc14517242770227d1e0a59.slice/crio-2377b5b824b3af50b5a44aba45189875cb46395467d1d36f00591fd5edefb81f WatchSource:0}: Error finding container 2377b5b824b3af50b5a44aba45189875cb46395467d1d36f00591fd5edefb81f: Status 404 returned error can't find the container with id 2377b5b824b3af50b5a44aba45189875cb46395467d1d36f00591fd5edefb81f
May 27 01:58:56.481721 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.481706    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 01:58:56.482791 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.482771    2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-prcx9"
May 27 01:58:56.527256 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.527232    2546 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:58:56.539221 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.539204    2546 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
May 27 01:58:56.545894 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.545862    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal" event={"ID":"f1da4437bdc14517242770227d1e0a59","Type":"ContainerStarted","Data":"2377b5b824b3af50b5a44aba45189875cb46395467d1d36f00591fd5edefb81f"}
May 27 01:58:56.546675 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.546655    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal" event={"ID":"5fc9d2da8a761350521ba6c477b33b3c","Type":"ContainerStarted","Data":"f8cc753c3703ad811c4aac9c76a2dad10648bdc9cb0f3f2fd201b2a5605f8c77"}
May 27 01:58:56.552930 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.552917    2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 01:58:56.554034 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.554023    2546 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
May 27 01:58:56.562080 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:56.562068    2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 01:58:57.407043 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.407005    2546 apiserver.go:52] "Watching apiserver"
May 27 01:58:57.414179 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.414151    2546 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 01:58:57.416807 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.416747    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-bbwkl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal","openshift-multus/multus-additional-cni-plugins-n84kv","openshift-multus/multus-dcwrh","openshift-multus/network-metrics-daemon-zdfpv","openshift-network-diagnostics/network-check-target-kk9c7","openshift-network-operator/iptables-alerter-5jn6n","kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx","openshift-cluster-node-tuning-operator/tuned-lqpp2","openshift-dns/node-resolver-pxkhd","openshift-ovn-kubernetes/ovnkube-node-2rk7n","kube-system/konnectivity-agent-rg4nb"]
May 27 01:58:57.419478 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.419455    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.422740 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.422713    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 01:58:57.422861 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.422726    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 01:58:57.423436 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.422958    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 01:58:57.423436 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.423135    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mbrr7\""
May 27 01:58:57.426187 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.426166    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.428011 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.427988    2546 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:58:57.428157 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.428136    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.428623 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.428526    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 01:58:57.428782 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.428759    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 01:58:57.428872 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.428784    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 01:58:57.428872 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.428798    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 01:58:57.428954 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.428906    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rs54n\""
May 27 01:58:57.428998 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.428981    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 01:58:57.431064 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.431003    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:57.431139 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:57.431095    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:58:57.431683 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.431658    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 01:58:57.431768 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.431735    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fqpjq\""
May 27 01:58:57.433137 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.433122    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:58:57.433227 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:57.433185    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:58:57.433227 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.433218    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.435453 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.435435    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.435840 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.435822    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 01:58:57.435936 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.435831    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 01:58:57.436183 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.436167    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 01:58:57.437309 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.437080    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sjzn9\""
May 27 01:58:57.437767 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.437735    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.438257 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.438241    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 01:58:57.438257 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.438248    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5k5pj\""
May 27 01:58:57.438418 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.438306    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 01:58:57.438418 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.438248    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 01:58:57.439659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.439641    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q9mqk\""
May 27 01:58:57.439953 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.439924    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.440744 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.440728    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 01:58:57.440904 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.440890    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 01:58:57.442218 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.442198    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.442327 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.442309    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 01:58:57.442588 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.442572    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 01:58:57.442667 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.442573    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xtxbx\""
May 27 01:58:57.444361 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.444333    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:58:57.444594 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.444567    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 01:58:57.445275 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.445257    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 01:58:57.445386 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.445257    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 01:58:57.445714 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.445575    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 01:58:57.446542 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.446413    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 01:58:57.446622 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.446575    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 01:58:57.447126 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447111    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 01:58:57.447510 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447493    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 01:58:57.447747 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447727    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n4dbc\""
May 27 01:58:57.447813 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447797    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-socket-dir-parent\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.447876 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447860    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:58:57.447913 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447892    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-socket-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.447945 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447915    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-host\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.447945 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447937    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-host\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.448027 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447954    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-tuned\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448027 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.447995    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-kubernetes\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448112 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448030    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-k8s-cni-cncf-io\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448112 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448063    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-device-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.448112 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448089    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-cni-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448243 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448112    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-cni-multus\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448243 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448136    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-hostroot\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448243 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448174    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-cnibin\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448243 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448210    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-daemon-config\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448243 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448235    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-etc-kubernetes\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448264    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysconfig\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448282    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xgxwr\""
May 27 01:58:57.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448297    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448333    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448385    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-sys\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448450    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-hosts-file\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448477    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-cni-binary-copy\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448510    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-cni-binary-copy\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448535    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-multus-certs\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448550    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-modprobe-d\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448592    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysctl-conf\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448607    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-serviceca\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448622    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-system-cni-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448642    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-os-release\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448684    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-systemd\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448707    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448725    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-registration-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448745    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448783    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phlvx\" (UniqueName: \"kubernetes.io/projected/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-kube-api-access-phlvx\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448824    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-var-lib-kubelet\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448841    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ef2ab27-0259-4a0f-917f-207cc376b402-host-slash\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448862    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb719311-7963-4409-b1bf-5ee45d1bf7df-tmp\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.448868 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448877    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqzw\" (UniqueName: \"kubernetes.io/projected/8ef2ab27-0259-4a0f-917f-207cc376b402-kube-api-access-vfqzw\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.449488 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448893    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsszz\" (UniqueName: \"kubernetes.io/projected/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-kube-api-access-zsszz\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:57.449488 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448927    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-system-cni-dir\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.449488 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448965    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-cnibin\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.449488 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.448989    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.449488 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449011    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-cni-bin\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.449488 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449030    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-kubelet\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.449488 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449056    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-os-release\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.449488 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449090    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-conf-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.449807 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449692    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysctl-d\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.449807 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449720    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-lib-modules\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.449807 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449742    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6c6b\" (UniqueName: \"kubernetes.io/projected/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-kube-api-access-k6c6b\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.449807 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449767    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-tmp-dir\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.449807 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449788    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcmf8\" (UniqueName: \"kubernetes.io/projected/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-kube-api-access-bcmf8\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.449807 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449802    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t6wn\" (UniqueName: \"kubernetes.io/projected/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-kube-api-access-2t6wn\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.450049 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449827    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-sys-fs\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.450049 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449844    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-run\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.450049 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449862    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.450049 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449877    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q56qp\" (UniqueName: \"kubernetes.io/projected/eb719311-7963-4409-b1bf-5ee45d1bf7df-kube-api-access-q56qp\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.450049 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449891    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrkmq\" (UniqueName: \"kubernetes.io/projected/654c5a26-d73f-42b0-b44f-8e76e6b56685-kube-api-access-jrkmq\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.450049 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449912    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-netns\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.450049 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.449959    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ef2ab27-0259-4a0f-917f-207cc376b402-iptables-alerter-script\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.483436 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.483405    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 01:53:56 +0000 UTC" deadline="2028-01-10 01:41:21.258391317 +0000 UTC"
May 27 01:58:57.483436 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.483435    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14231h42m23.774959294s"
May 27 01:58:57.539777 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.539750    2546 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 01:58:57.550630 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550609    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsszz\" (UniqueName: \"kubernetes.io/projected/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-kube-api-access-zsszz\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:57.550630 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550637    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-system-cni-dir\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.550761 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550655    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-cnibin\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.550761 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550670    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.550761 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550723    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-system-cni-dir\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.550761 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550748    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-cni-bin\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.550901 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550723    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-cnibin\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.550901 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550790    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-cni-bin\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.550901 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550818    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-kubelet\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.550901 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550842    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-os-release\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.550901 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550861    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-kubelet\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.550901 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550866    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-conf-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.550901 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550889    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysctl-d\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550908    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550917    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/654c5a26-d73f-42b0-b44f-8e76e6b56685-os-release\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550923    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-etc-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550946    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550950    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-conf-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.550969    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-cni-bin\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551007    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysctl-d\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551012    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-lib-modules\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551046    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6c6b\" (UniqueName: \"kubernetes.io/projected/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-kube-api-access-k6c6b\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551073    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-tmp-dir\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551099    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcmf8\" (UniqueName: \"kubernetes.io/projected/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-kube-api-access-bcmf8\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551122    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-lib-modules\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551127    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-systemd\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551167    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovnkube-config\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551186    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovn-node-metrics-cert\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551211    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2t6wn\" (UniqueName: \"kubernetes.io/projected/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-kube-api-access-2t6wn\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.551214 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551229    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-sys-fs\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551246    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-run\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551262    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq94z\" (UniqueName: \"kubernetes.io/projected/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-kube-api-access-qq94z\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551287    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551304    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q56qp\" (UniqueName: \"kubernetes.io/projected/eb719311-7963-4409-b1bf-5ee45d1bf7df-kube-api-access-q56qp\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551335    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-run\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551389    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551392    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-tmp-dir\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551413    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-sys-fs\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551453    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-var-lib-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551498    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrkmq\" (UniqueName: \"kubernetes.io/projected/654c5a26-d73f-42b0-b44f-8e76e6b56685-kube-api-access-jrkmq\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551528    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-netns\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551551    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ef2ab27-0259-4a0f-917f-207cc376b402-iptables-alerter-script\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551568    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-run-netns\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551592    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-netns\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551595    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551630    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-socket-dir-parent\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.552089 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551648    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551663    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-socket-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551681    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-host\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551704    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-host\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551726    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-log-socket\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551743    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-kubelet\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551765    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-tuned\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551770    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-host\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551721    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-socket-dir-parent\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551790    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-kubernetes\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551823    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-kubernetes\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551825    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-k8s-cni-cncf-io\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551847    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-device-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551845    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-socket-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551871    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-env-overrides\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551898    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-cni-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551911    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-device-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551916    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-host\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.552737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551944    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-k8s-cni-cncf-io\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551927    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-cni-multus\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551979    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-hostroot\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551989    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-cni-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.551979    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-var-lib-cni-multus\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552005    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-node-log\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552011    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-hostroot\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552039    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-cnibin\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552068    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ef2ab27-0259-4a0f-917f-207cc376b402-iptables-alerter-script\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552115    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-cnibin\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552104    2546 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552066    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-daemon-config\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552192    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-etc-kubernetes\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552218    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysconfig\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552230    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-etc-kubernetes\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552243    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-slash\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552268    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552285    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysconfig\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.553617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552298    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552333    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552406    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-sys\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552432    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-hosts-file\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552459    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-ovn\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552492    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovnkube-script-lib\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552521    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-cni-binary-copy\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552546    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-cni-binary-copy\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552572    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-multus-daemon-config\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552619    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-multus-certs\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552662    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-hosts-file\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552575    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-host-run-multus-certs\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552695    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-modprobe-d\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552720    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysctl-conf\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552741    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-serviceca\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552765    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-system-cni-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552787    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-os-release\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552811    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-systemd\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.554114 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552833    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552836    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552859    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-systemd-units\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552886    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-registration-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552892    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552910    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552947    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phlvx\" (UniqueName: \"kubernetes.io/projected/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-kube-api-access-phlvx\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552959    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552620    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-sys\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.552975    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-var-lib-kubelet\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553004    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ef2ab27-0259-4a0f-917f-207cc376b402-host-slash\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553018    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-var-lib-kubelet\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553031    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-cni-netd\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553100    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/654c5a26-d73f-42b0-b44f-8e76e6b56685-cni-binary-copy\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553133    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c86fb19-d79b-477c-9b82-ff2398809370-agent-certs\") pod \"konnectivity-agent-rg4nb\" (UID: \"4c86fb19-d79b-477c-9b82-ff2398809370\") " pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553156    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-sysctl-conf\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553214    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-registration-dir\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.554659 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553157    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c86fb19-d79b-477c-9b82-ff2398809370-konnectivity-ca\") pod \"konnectivity-agent-rg4nb\" (UID: \"4c86fb19-d79b-477c-9b82-ff2398809370\") " pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553263    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb719311-7963-4409-b1bf-5ee45d1bf7df-tmp\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553266    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-cni-binary-copy\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:57.553282    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553326    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ef2ab27-0259-4a0f-917f-207cc376b402-host-slash\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553331    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-system-cni-dir\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:57.553430    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 01:58:58.053394423 +0000 UTC m=+3.137732706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553327    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqzw\" (UniqueName: \"kubernetes.io/projected/8ef2ab27-0259-4a0f-917f-207cc376b402-kube-api-access-vfqzw\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553430    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-modprobe-d\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553563    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-os-release\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553573    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-serviceca\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.555408 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.553632    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-systemd\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.555822 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.555774    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb719311-7963-4409-b1bf-5ee45d1bf7df-etc-tuned\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.555891 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.555876    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb719311-7963-4409-b1bf-5ee45d1bf7df-tmp\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.563863 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:57.563846    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:58:57.563863 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:57.563864    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:58:57.564016 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:57.563872    2546 projected.go:194] Error preparing data for projected volume kube-api-access-7tv8d for pod openshift-network-diagnostics/network-check-target-kk9c7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:58:57.564016 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:57.563923    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d podName:ee6567a5-1576-4ea7-b9eb-d771924c8967 nodeName:}" failed. No retries permitted until 2026-05-27 01:58:58.06390559 +0000 UTC m=+3.148243894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7tv8d" (UniqueName: "kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d") pod "network-check-target-kk9c7" (UID: "ee6567a5-1576-4ea7-b9eb-d771924c8967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:58:57.566595 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.566565    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6c6b\" (UniqueName: \"kubernetes.io/projected/6eedf9d0-32bb-47c6-8205-8e53b3a43ded-kube-api-access-k6c6b\") pod \"node-ca-bbwkl\" (UID: \"6eedf9d0-32bb-47c6-8205-8e53b3a43ded\") " pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.566693 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.566598    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrkmq\" (UniqueName: \"kubernetes.io/projected/654c5a26-d73f-42b0-b44f-8e76e6b56685-kube-api-access-jrkmq\") pod \"multus-additional-cni-plugins-n84kv\" (UID: \"654c5a26-d73f-42b0-b44f-8e76e6b56685\") " pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.567133 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.567106    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcmf8\" (UniqueName: \"kubernetes.io/projected/ebdb4199-7ea7-42c4-8c69-ba63d7049d8e-kube-api-access-bcmf8\") pod \"node-resolver-pxkhd\" (UID: \"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e\") " pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.567895 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.567391    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phlvx\" (UniqueName: \"kubernetes.io/projected/3ae4e048-7590-4b5d-9c3b-8f0beaaf72df-kube-api-access-phlvx\") pod \"aws-ebs-csi-driver-node-hqmtx\" (UID: \"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.567981 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.567878    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsszz\" (UniqueName: \"kubernetes.io/projected/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-kube-api-access-zsszz\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:57.568088 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.568068    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t6wn\" (UniqueName: \"kubernetes.io/projected/7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230-kube-api-access-2t6wn\") pod \"multus-dcwrh\" (UID: \"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230\") " pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.568381 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.568365    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q56qp\" (UniqueName: \"kubernetes.io/projected/eb719311-7963-4409-b1bf-5ee45d1bf7df-kube-api-access-q56qp\") pod \"tuned-lqpp2\" (UID: \"eb719311-7963-4409-b1bf-5ee45d1bf7df\") " pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.569153 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.569135    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqzw\" (UniqueName: \"kubernetes.io/projected/8ef2ab27-0259-4a0f-917f-207cc376b402-kube-api-access-vfqzw\") pod \"iptables-alerter-5jn6n\" (UID: \"8ef2ab27-0259-4a0f-917f-207cc376b402\") " pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.654629 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654600    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-env-overrides\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654629 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654632    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-node-log\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654650    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-slash\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654697    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-slash\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654704    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-node-log\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654733    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654756    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-ovn\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654772    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovnkube-script-lib\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654813    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-systemd-units\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.654825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654824    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-ovn\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654839    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-cni-netd\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654862    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c86fb19-d79b-477c-9b82-ff2398809370-agent-certs\") pod \"konnectivity-agent-rg4nb\" (UID: \"4c86fb19-d79b-477c-9b82-ff2398809370\") " pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654859    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654885    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c86fb19-d79b-477c-9b82-ff2398809370-konnectivity-ca\") pod \"konnectivity-agent-rg4nb\" (UID: \"4c86fb19-d79b-477c-9b82-ff2398809370\") " pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654917    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-etc-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654942    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654968    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-cni-bin\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654975    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-systemd-units\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654996    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-systemd\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655017    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-etc-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655020    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovnkube-config\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655061    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovn-node-metrics-cert\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655079 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655075    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.654940    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-cni-netd\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655091    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq94z\" (UniqueName: \"kubernetes.io/projected/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-kube-api-access-qq94z\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655107    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-env-overrides\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655118    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-var-lib-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655123    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-cni-bin\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655150    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-var-lib-openvswitch\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655150    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-run-netns\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655164    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-run-systemd\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655182    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-run-netns\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655194    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655234    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-log-socket\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655260    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-kubelet\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655302    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovnkube-script-lib\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655314    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-kubelet\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655371    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.655578 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655373    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-log-socket\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.656260 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655688    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c86fb19-d79b-477c-9b82-ff2398809370-konnectivity-ca\") pod \"konnectivity-agent-rg4nb\" (UID: \"4c86fb19-d79b-477c-9b82-ff2398809370\") " pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:58:57.656260 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.655936    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovnkube-config\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.657646 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.657595    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c86fb19-d79b-477c-9b82-ff2398809370-agent-certs\") pod \"konnectivity-agent-rg4nb\" (UID: \"4c86fb19-d79b-477c-9b82-ff2398809370\") " pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:58:57.657976 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.657950    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-ovn-node-metrics-cert\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.664378 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.664336    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq94z\" (UniqueName: \"kubernetes.io/projected/a1f8dcf0-efe7-44dc-b941-b0d3aa60524d-kube-api-access-qq94z\") pod \"ovnkube-node-2rk7n\" (UID: \"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.695703 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.695678    2546 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:58:57.732662 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.732623    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jn6n"
May 27 01:58:57.740302 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.740284    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n84kv"
May 27 01:58:57.749807 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.749784    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dcwrh"
May 27 01:58:57.755369 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.755336    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bbwkl"
May 27 01:58:57.760895 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.760870    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx"
May 27 01:58:57.768440 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.768421    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqpp2"
May 27 01:58:57.773930 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.773902    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxkhd"
May 27 01:58:57.781517 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.781499    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:58:57.786134 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:57.786112    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:58:58.056589 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.056527    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:58.056719 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:58.056663    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:58:58.056755 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:58.056722    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 01:58:59.05670567 +0000 UTC m=+4.141043929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:58:58.073968 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:58.073928    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acdc3b2_f3ec_4b0a_ab16_e6e8b2ca1230.slice/crio-0dece445e6cb0d1a133980e977ed18b08970bef8c0f86abbc75f92142c6ed312 WatchSource:0}: Error finding container 0dece445e6cb0d1a133980e977ed18b08970bef8c0f86abbc75f92142c6ed312: Status 404 returned error can't find the container with id 0dece445e6cb0d1a133980e977ed18b08970bef8c0f86abbc75f92142c6ed312
May 27 01:58:58.075772 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:58.075746    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654c5a26_d73f_42b0_b44f_8e76e6b56685.slice/crio-76dec35994b2df74dafa7ec3fed445734259d1cc85f929dbe80d30c463f241ef WatchSource:0}: Error finding container 76dec35994b2df74dafa7ec3fed445734259d1cc85f929dbe80d30c463f241ef: Status 404 returned error can't find the container with id 76dec35994b2df74dafa7ec3fed445734259d1cc85f929dbe80d30c463f241ef
May 27 01:58:58.078522 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:58.078496    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f8dcf0_efe7_44dc_b941_b0d3aa60524d.slice/crio-fd592e2b6368dfaab698d179042f2cc6ec627166b8d00cc18d16e462e4ad9e10 WatchSource:0}: Error finding container fd592e2b6368dfaab698d179042f2cc6ec627166b8d00cc18d16e462e4ad9e10: Status 404 returned error can't find the container with id fd592e2b6368dfaab698d179042f2cc6ec627166b8d00cc18d16e462e4ad9e10
May 27 01:58:58.079116 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:58.079094    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c86fb19_d79b_477c_9b82_ff2398809370.slice/crio-737076d7179c744f734d114a048f2f2a553b85fab6b0290460c7fb85e1d5d9ea WatchSource:0}: Error finding container 737076d7179c744f734d114a048f2f2a553b85fab6b0290460c7fb85e1d5d9ea: Status 404 returned error can't find the container with id 737076d7179c744f734d114a048f2f2a553b85fab6b0290460c7fb85e1d5d9ea
May 27 01:58:58.100952 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:58.100934    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eedf9d0_32bb_47c6_8205_8e53b3a43ded.slice/crio-717b19545b1d39aab24364160c3558e9c2230357b240b868643120be782bd60b WatchSource:0}: Error finding container 717b19545b1d39aab24364160c3558e9c2230357b240b868643120be782bd60b: Status 404 returned error can't find the container with id 717b19545b1d39aab24364160c3558e9c2230357b240b868643120be782bd60b
May 27 01:58:58.106935 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:58:58.106914    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae4e048_7590_4b5d_9c3b_8f0beaaf72df.slice/crio-2f275160fb3ff46e8eb0cb5c34b9180a2624de5efc81e47b9bc52e4287d0f77d WatchSource:0}: Error finding container 2f275160fb3ff46e8eb0cb5c34b9180a2624de5efc81e47b9bc52e4287d0f77d: Status 404 returned error can't find the container with id 2f275160fb3ff46e8eb0cb5c34b9180a2624de5efc81e47b9bc52e4287d0f77d
May 27 01:58:58.157758 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.157739    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:58:58.157876 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:58.157864    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:58:58.157914 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:58.157882    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:58:58.157914 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:58.157891    2546 projected.go:194] Error preparing data for projected volume kube-api-access-7tv8d for pod openshift-network-diagnostics/network-check-target-kk9c7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:58:58.157980 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:58.157931    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d podName:ee6567a5-1576-4ea7-b9eb-d771924c8967 nodeName:}" failed. No retries permitted until 2026-05-27 01:58:59.157920122 +0000 UTC m=+4.242258382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tv8d" (UniqueName: "kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d") pod "network-check-target-kk9c7" (UID: "ee6567a5-1576-4ea7-b9eb-d771924c8967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:58:58.484244 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.484200    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 01:53:56 +0000 UTC" deadline="2027-12-21 07:04:34.964464109 +0000 UTC"
May 27 01:58:58.484244 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.484237    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13757h5m36.480230721s"
May 27 01:58:58.515491 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.515438    2546 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:58:58.543909 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.543882    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:58:58.544061 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:58.544010    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:58:58.544451 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.544407    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:58.544562 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:58.544518    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:58:58.556716 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.556639    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rg4nb" event={"ID":"4c86fb19-d79b-477c-9b82-ff2398809370","Type":"ContainerStarted","Data":"737076d7179c744f734d114a048f2f2a553b85fab6b0290460c7fb85e1d5d9ea"}
May 27 01:58:58.559059 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.559036    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"fd592e2b6368dfaab698d179042f2cc6ec627166b8d00cc18d16e462e4ad9e10"}
May 27 01:58:58.564421 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.564395    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n84kv" event={"ID":"654c5a26-d73f-42b0-b44f-8e76e6b56685","Type":"ContainerStarted","Data":"76dec35994b2df74dafa7ec3fed445734259d1cc85f929dbe80d30c463f241ef"}
May 27 01:58:58.568371 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.568329    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal" event={"ID":"f1da4437bdc14517242770227d1e0a59","Type":"ContainerStarted","Data":"7cfb92f62e82832cef682c4983156aa0e53039fdad9e063097cf8e7748133543"}
May 27 01:58:58.572148 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.572123    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxkhd" event={"ID":"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e","Type":"ContainerStarted","Data":"9def333cdf98b7e3640fe0df3bf8dea177a8d0337e4f549369741a82abd18c62"}
May 27 01:58:58.589486 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.589449    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dcwrh" event={"ID":"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230","Type":"ContainerStarted","Data":"0dece445e6cb0d1a133980e977ed18b08970bef8c0f86abbc75f92142c6ed312"}
May 27 01:58:58.593769 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.593062    2546 generic.go:358] "Generic (PLEG): container finished" podID="5fc9d2da8a761350521ba6c477b33b3c" containerID="a89f744bbf92d3ba26e607e356f36bee1715d108f0f1e0e607f1390296c522ea" exitCode=0
May 27 01:58:58.593769 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.593125    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal" event={"ID":"5fc9d2da8a761350521ba6c477b33b3c","Type":"ContainerDied","Data":"a89f744bbf92d3ba26e607e356f36bee1715d108f0f1e0e607f1390296c522ea"}
May 27 01:58:58.607797 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.603559    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx" event={"ID":"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df","Type":"ContainerStarted","Data":"2f275160fb3ff46e8eb0cb5c34b9180a2624de5efc81e47b9bc52e4287d0f77d"}
May 27 01:58:58.607797 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.607110    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jn6n" event={"ID":"8ef2ab27-0259-4a0f-917f-207cc376b402","Type":"ContainerStarted","Data":"e7595d2643a63476beac524a2712a53112dd6eb7bb03947f091961ef32279965"}
May 27 01:58:58.611200 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.611181    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqpp2" event={"ID":"eb719311-7963-4409-b1bf-5ee45d1bf7df","Type":"ContainerStarted","Data":"6d7646cad8ce4dc4d70ba19b75a0f0d4c18f41528833efca9d82246bd5c99d73"}
May 27 01:58:58.612788 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.612739    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bbwkl" event={"ID":"6eedf9d0-32bb-47c6-8205-8e53b3a43ded","Type":"ContainerStarted","Data":"717b19545b1d39aab24364160c3558e9c2230357b240b868643120be782bd60b"}
May 27 01:58:58.615373 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:58.615305    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal" podStartSLOduration=2.615291756 podStartE2EDuration="2.615291756s" podCreationTimestamp="2026-05-27 01:58:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 01:58:58.583501713 +0000 UTC m=+3.667839996" watchObservedRunningTime="2026-05-27 01:58:58.615291756 +0000 UTC m=+3.699630039"
May 27 01:58:59.065725 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:59.065685    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:58:59.065871 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:59.065835    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:58:59.065941 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:59.065893    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 01:59:01.065876095 +0000 UTC m=+6.150214374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:58:59.167154 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:59.167059    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:58:59.167296 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:59.167231    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:58:59.167296 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:59.167258    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:58:59.167296 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:59.167272    2546 projected.go:194] Error preparing data for projected volume kube-api-access-7tv8d for pod openshift-network-diagnostics/network-check-target-kk9c7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:58:59.167563 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:58:59.167329    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d podName:ee6567a5-1576-4ea7-b9eb-d771924c8967 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:01.167308723 +0000 UTC m=+6.251646987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tv8d" (UniqueName: "kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d") pod "network-check-target-kk9c7" (UID: "ee6567a5-1576-4ea7-b9eb-d771924c8967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:58:59.627537 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:59.627420    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal" event={"ID":"5fc9d2da8a761350521ba6c477b33b3c","Type":"ContainerStarted","Data":"b9793c7952c6c3518561812c1f182b4221041af29e8ff4e2362d2df4f1ecb6a4"}
May 27 01:58:59.648229 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:58:59.647295    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal" podStartSLOduration=3.647277732 podStartE2EDuration="3.647277732s" podCreationTimestamp="2026-05-27 01:58:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 01:58:59.646253993 +0000 UTC m=+4.730592278" watchObservedRunningTime="2026-05-27 01:58:59.647277732 +0000 UTC m=+4.731616015"
May 27 01:59:00.544875 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:00.544359    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:00.544875 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:00.544360    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:00.544875 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:00.544514    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:00.544875 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:00.544559    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:01.079130 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:01.079091    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:01.079593 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:01.079256    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:01.079593 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:01.079316    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 01:59:05.079297673 +0000 UTC m=+10.163635938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:01.179781 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:01.179723    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:01.179951 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:01.179927    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:01.179951 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:01.179945    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:01.180058 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:01.179955    2546 projected.go:194] Error preparing data for projected volume kube-api-access-7tv8d for pod openshift-network-diagnostics/network-check-target-kk9c7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:01.180058 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:01.180007    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d podName:ee6567a5-1576-4ea7-b9eb-d771924c8967 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:05.179988415 +0000 UTC m=+10.264326689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tv8d" (UniqueName: "kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d") pod "network-check-target-kk9c7" (UID: "ee6567a5-1576-4ea7-b9eb-d771924c8967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:02.543710 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:02.543675    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:02.544154 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:02.543790    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:02.544231 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:02.544175    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:02.544306 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:02.544285    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:04.543704 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:04.543665    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:04.544063 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:04.543780    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:04.544119 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:04.544096    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:04.544183 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:04.544155    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:05.115589 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:05.115550    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:05.115762 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:05.115699    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:05.115762 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:05.115761    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 01:59:13.115740355 +0000 UTC m=+18.200078618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:05.216155 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:05.216118    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:05.216314 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:05.216253    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:05.216314 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:05.216272    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:05.216314 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:05.216282    2546 projected.go:194] Error preparing data for projected volume kube-api-access-7tv8d for pod openshift-network-diagnostics/network-check-target-kk9c7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:05.216517 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:05.216335    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d podName:ee6567a5-1576-4ea7-b9eb-d771924c8967 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:13.21631767 +0000 UTC m=+18.300655935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tv8d" (UniqueName: "kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d") pod "network-check-target-kk9c7" (UID: "ee6567a5-1576-4ea7-b9eb-d771924c8967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:06.544037 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:06.543521    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:06.544037 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:06.543629    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:06.544037 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:06.543523    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:06.544037 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:06.543999    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:08.544109 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:08.543863    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:08.544556 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:08.543909    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:08.544556 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:08.544151    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:08.544556 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:08.544236    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:10.544241 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:10.544208    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:10.544679 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:10.544214    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:10.544679 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:10.544338    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:10.544679 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:10.544454    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:12.544023 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:12.543984    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:12.544441 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:12.543984    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:12.544441 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:12.544091    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:12.544441 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:12.544164    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:13.175012 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:13.174977    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:13.175285 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:13.175099    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:13.175285 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:13.175164    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 01:59:29.175145177 +0000 UTC m=+34.259483436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:13.275600 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:13.275568    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:13.275764 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:13.275676    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:13.275764 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:13.275695    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:13.275764 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:13.275707    2546 projected.go:194] Error preparing data for projected volume kube-api-access-7tv8d for pod openshift-network-diagnostics/network-check-target-kk9c7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:13.275764 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:13.275761    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d podName:ee6567a5-1576-4ea7-b9eb-d771924c8967 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:29.275747719 +0000 UTC m=+34.360085979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tv8d" (UniqueName: "kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d") pod "network-check-target-kk9c7" (UID: "ee6567a5-1576-4ea7-b9eb-d771924c8967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:14.543527 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:14.543494    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:14.543527 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:14.543525    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:14.544003 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:14.543621    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:14.544003 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:14.543733    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:16.543549 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.543476    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:16.544471 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:16.543617    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:16.544471 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.543701    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:16.544471 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:16.543772    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:16.657416 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.657382    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx" event={"ID":"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df","Type":"ContainerStarted","Data":"0492162a633167740ef7cca38b91772c18c8e203c275bce356f97230f2e233c7"}
May 27 01:59:16.658762 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.658731    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqpp2" event={"ID":"eb719311-7963-4409-b1bf-5ee45d1bf7df","Type":"ContainerStarted","Data":"48f50f0dd650f7e453d2fba0429e4376416f3679a5c3380eafc7419f4b55b1b9"}
May 27 01:59:16.660050 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.660030    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bbwkl" event={"ID":"6eedf9d0-32bb-47c6-8205-8e53b3a43ded","Type":"ContainerStarted","Data":"b4911500332230ee6b92cf773720349ae1579a740932df4497ddefcdc519d947"}
May 27 01:59:16.661226 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.661208    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rg4nb" event={"ID":"4c86fb19-d79b-477c-9b82-ff2398809370","Type":"ContainerStarted","Data":"22a76f5f7d7774bacb00972d489807267c8518e489399e40c3c4b7943cb7da88"}
May 27 01:59:16.662499 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.662478    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"fff0e93a0e3b291900a80be242ac8475164c26384d40d73ed9895860fd1ec443"}
May 27 01:59:16.663758 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.663737    2546 generic.go:358] "Generic (PLEG): container finished" podID="654c5a26-d73f-42b0-b44f-8e76e6b56685" containerID="bf8604dc8160245ed26c6e0e7349c7d232461976a96f2ad174fa3dfd099df6fa" exitCode=0
May 27 01:59:16.663840 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.663809    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n84kv" event={"ID":"654c5a26-d73f-42b0-b44f-8e76e6b56685","Type":"ContainerDied","Data":"bf8604dc8160245ed26c6e0e7349c7d232461976a96f2ad174fa3dfd099df6fa"}
May 27 01:59:16.665019 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.665000    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxkhd" event={"ID":"ebdb4199-7ea7-42c4-8c69-ba63d7049d8e","Type":"ContainerStarted","Data":"3be0fcdfa975b07991d4bf35cbf0af950fe0848742e61d8402ce5857195e08b9"}
May 27 01:59:16.666191 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.666171    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dcwrh" event={"ID":"7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230","Type":"ContainerStarted","Data":"b59c0c621a78721194f4fc68e8de22b46916044b655a067fb31c969a75cfa18f"}
May 27 01:59:16.676565 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.676520    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lqpp2" podStartSLOduration=3.685833073 podStartE2EDuration="21.676504987s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.109303434 +0000 UTC m=+3.193641706" lastFinishedPulling="2026-05-27 01:59:16.099975343 +0000 UTC m=+21.184313620" observedRunningTime="2026-05-27 01:59:16.675984607 +0000 UTC m=+21.760322880" watchObservedRunningTime="2026-05-27 01:59:16.676504987 +0000 UTC m=+21.760843273"
May 27 01:59:16.693153 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.693121    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rg4nb" podStartSLOduration=3.718504105 podStartE2EDuration="21.693110291s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.099892797 +0000 UTC m=+3.184231056" lastFinishedPulling="2026-05-27 01:59:16.074498975 +0000 UTC m=+21.158837242" observedRunningTime="2026-05-27 01:59:16.693092395 +0000 UTC m=+21.777430677" watchObservedRunningTime="2026-05-27 01:59:16.693110291 +0000 UTC m=+21.777448612"
May 27 01:59:16.742127 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.742086    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-pxkhd" podStartSLOduration=3.776717287 podStartE2EDuration="21.742075477s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.109053547 +0000 UTC m=+3.193391820" lastFinishedPulling="2026-05-27 01:59:16.07441175 +0000 UTC m=+21.158750010" observedRunningTime="2026-05-27 01:59:16.741839459 +0000 UTC m=+21.826177742" watchObservedRunningTime="2026-05-27 01:59:16.742075477 +0000 UTC m=+21.826413758"
May 27 01:59:16.744782 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.742777    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bbwkl" podStartSLOduration=3.774157426 podStartE2EDuration="21.742760107s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.105712422 +0000 UTC m=+3.190050685" lastFinishedPulling="2026-05-27 01:59:16.074315105 +0000 UTC m=+21.158653366" observedRunningTime="2026-05-27 01:59:16.727787114 +0000 UTC m=+21.812125395" watchObservedRunningTime="2026-05-27 01:59:16.742760107 +0000 UTC m=+21.827098392"
May 27 01:59:16.761108 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:16.761067    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dcwrh" podStartSLOduration=3.723061829 podStartE2EDuration="21.76105329s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.075873162 +0000 UTC m=+3.160211425" lastFinishedPulling="2026-05-27 01:59:16.113864626 +0000 UTC m=+21.198202886" observedRunningTime="2026-05-27 01:59:16.760886412 +0000 UTC m=+21.845224694" watchObservedRunningTime="2026-05-27 01:59:16.76105329 +0000 UTC m=+21.845391573"
May 27 01:59:17.670407 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:17.670337    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 01:59:17.670805 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:17.670726    2546 generic.go:358] "Generic (PLEG): container finished" podID="a1f8dcf0-efe7-44dc-b941-b0d3aa60524d" containerID="7c5e7bdd2f213c8ed523ee49c59fc9860e7252b609168a3b92c07f4cd62e3dc3" exitCode=1
May 27 01:59:17.671393 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:17.671370    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"bab0b4fb402152d3f9504eba5b080769b269626caf4c0644623c9eceaf9cb8f7"}
May 27 01:59:17.671490 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:17.671403    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"472f0ebf70a3161832f4c2728d24c5725341ed041f5f6113fa53a4dcfa80e4d5"}
May 27 01:59:17.671490 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:17.671417    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"b0224d5c5c375afc4a63d86b357c66cce48deae061371829c82bfd231a8fbc86"}
May 27 01:59:17.671490 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:17.671430    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"be93b65374050222d4b745446a6cfbd0a2742e844dbb263eb016b33d555c6ede"}
May 27 01:59:17.671490 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:17.671442    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerDied","Data":"7c5e7bdd2f213c8ed523ee49c59fc9860e7252b609168a3b92c07f4cd62e3dc3"}
May 27 01:59:17.772845 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:17.772807    2546 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 01:59:18.513386 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:18.512937    2546 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T01:59:17.772829213Z","UUID":"3122518f-ed85-4f1d-a941-32b6338a7f60","Handler":null,"Name":"","Endpoint":""}
May 27 01:59:18.514747 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:18.514719    2546 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 01:59:18.514747 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:18.514749    2546 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 01:59:18.543476 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:18.543441    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:18.543598 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:18.543560    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:18.543825 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:18.543810    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:18.543886 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:18.543873    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:18.674746 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:18.674715    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx" event={"ID":"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df","Type":"ContainerStarted","Data":"8c29a0f0e45b8c34bd2cdba1ac0082f4e9e356cef62d74aadd9187ab2b58ceb2"}
May 27 01:59:18.676082 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:18.676040    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jn6n" event={"ID":"8ef2ab27-0259-4a0f-917f-207cc376b402","Type":"ContainerStarted","Data":"188201a0889a1e85221076eaac2551fb1f4b8e9df6dddbfd9547a53e813239a4"}
May 27 01:59:18.691393 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:18.691333    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5jn6n" podStartSLOduration=5.694857326 podStartE2EDuration="23.69132224s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.108995907 +0000 UTC m=+3.193334181" lastFinishedPulling="2026-05-27 01:59:16.105460831 +0000 UTC m=+21.189799095" observedRunningTime="2026-05-27 01:59:18.690988348 +0000 UTC m=+23.775326626" watchObservedRunningTime="2026-05-27 01:59:18.69132224 +0000 UTC m=+23.775660523"
May 27 01:59:19.679876 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:19.679833    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx" event={"ID":"3ae4e048-7590-4b5d-9c3b-8f0beaaf72df","Type":"ContainerStarted","Data":"2f3d5983d042175ffa9bc163d3917960a28669136a325cf34c02eb3dc45580c3"}
May 27 01:59:19.699505 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:19.699462    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqmtx" podStartSLOduration=4.064955521 podStartE2EDuration="24.699449269s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.109168855 +0000 UTC m=+3.193507118" lastFinishedPulling="2026-05-27 01:59:18.743662593 +0000 UTC m=+23.828000866" observedRunningTime="2026-05-27 01:59:19.699283958 +0000 UTC m=+24.783622241" watchObservedRunningTime="2026-05-27 01:59:19.699449269 +0000 UTC m=+24.783787550"
May 27 01:59:20.543530 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:20.543497    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:20.543710 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:20.543499    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:20.543710 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:20.543616    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:20.543834 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:20.543714    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:20.683670 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:20.683647    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 01:59:20.684041 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:20.684008    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"58e17fb7c17fd220352e163c61b3fa78277f2a6588e4e80bd8a40517f4d8b5fb"}
May 27 01:59:20.882157 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:20.882102    2546 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:59:20.882789 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:20.882771    2546 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:59:21.687258 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:21.687229    2546 generic.go:358] "Generic (PLEG): container finished" podID="654c5a26-d73f-42b0-b44f-8e76e6b56685" containerID="da06d4ae663a9213fd82a3c7660939db5807c6979bfac41f162128d733ad1591" exitCode=0
May 27 01:59:21.687678 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:21.687324    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n84kv" event={"ID":"654c5a26-d73f-42b0-b44f-8e76e6b56685","Type":"ContainerDied","Data":"da06d4ae663a9213fd82a3c7660939db5807c6979bfac41f162128d733ad1591"}
May 27 01:59:21.687678 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:21.687649    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:59:21.688472 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:21.688436    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rg4nb"
May 27 01:59:22.543834 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:22.543639    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:22.543964 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:22.543639    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:22.543964 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:22.543907    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:22.544049 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:22.543975    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:22.690503 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:22.690480    2546 generic.go:358] "Generic (PLEG): container finished" podID="654c5a26-d73f-42b0-b44f-8e76e6b56685" containerID="eeb8011be68a7134be4afd450e137abd1f87ad0175d3943a7f98fc9fb6970e78" exitCode=0
May 27 01:59:22.690815 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:22.690574    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n84kv" event={"ID":"654c5a26-d73f-42b0-b44f-8e76e6b56685","Type":"ContainerDied","Data":"eeb8011be68a7134be4afd450e137abd1f87ad0175d3943a7f98fc9fb6970e78"}
May 27 01:59:23.695824 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:23.695766    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 01:59:23.696230 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:23.696140    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"e3e5ede4df8948ca1c522472d45ed511b666e1592e16afb379827c5a42cf32cb"}
May 27 01:59:23.696528 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:23.696496    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:59:23.696703 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:23.696677    2546 scope.go:117] "RemoveContainer" containerID="7c5e7bdd2f213c8ed523ee49c59fc9860e7252b609168a3b92c07f4cd62e3dc3"
May 27 01:59:23.699379 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:23.699327    2546 generic.go:358] "Generic (PLEG): container finished" podID="654c5a26-d73f-42b0-b44f-8e76e6b56685" containerID="6f0313cf93e07c0a12e2d0dbadc011ecae8361d1235f41c9e88a550a2d41e734" exitCode=0
May 27 01:59:23.699545 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:23.699397    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n84kv" event={"ID":"654c5a26-d73f-42b0-b44f-8e76e6b56685","Type":"ContainerDied","Data":"6f0313cf93e07c0a12e2d0dbadc011ecae8361d1235f41c9e88a550a2d41e734"}
May 27 01:59:23.714720 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:23.714697    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:59:24.236928 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.236740    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pswlj"]
May 27 01:59:24.239674 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.239650    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.239807 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.239729    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pswlj" podUID="2c1a212b-da65-402f-a034-be00e61f3e56"
May 27 01:59:24.366145 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.366090    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c1a212b-da65-402f-a034-be00e61f3e56-dbus\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.368302 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.368100    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c1a212b-da65-402f-a034-be00e61f3e56-kubelet-config\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.368302 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.368145    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.468792 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.468759    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c1a212b-da65-402f-a034-be00e61f3e56-dbus\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.468927 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.468850    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c1a212b-da65-402f-a034-be00e61f3e56-kubelet-config\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.468927 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.468882    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.469040 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.469018    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 01:59:24.469088 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.469082    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret podName:2c1a212b-da65-402f-a034-be00e61f3e56 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:24.969063983 +0000 UTC m=+30.053402268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret") pod "global-pull-secret-syncer-pswlj" (UID: "2c1a212b-da65-402f-a034-be00e61f3e56") : object "kube-system"/"original-pull-secret" not registered
May 27 01:59:24.469531 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.469505    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c1a212b-da65-402f-a034-be00e61f3e56-dbus\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.469612 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.469579    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c1a212b-da65-402f-a034-be00e61f3e56-kubelet-config\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.544170 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.544146    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:24.544296 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.544273    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:24.544384 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.544336    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:24.544591 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.544560    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:24.648887 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.648854    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kk9c7"]
May 27 01:59:24.651956 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.651909    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pswlj"]
May 27 01:59:24.653775 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.653653    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zdfpv"]
May 27 01:59:24.708095 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.708073    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 01:59:24.708989 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.708963    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:24.709116 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.709094    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:24.710485 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.710459    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" event={"ID":"a1f8dcf0-efe7-44dc-b941-b0d3aa60524d","Type":"ContainerStarted","Data":"cfa39a88ac2baa190617e57e0a1012ced67482b6fbb96d5857b52956913bdac3"}
May 27 01:59:24.710583 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.710533    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:24.710639 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.710615    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:24.710684 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.710671    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.710765 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.710748    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pswlj" podUID="2c1a212b-da65-402f-a034-be00e61f3e56"
May 27 01:59:24.710894 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.710881    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:59:24.710932 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.710913    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:59:24.730556 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.730535    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 01:59:24.775326 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.775275    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n" podStartSLOduration=11.422505573 podStartE2EDuration="29.775264192s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.100000003 +0000 UTC m=+3.184338263" lastFinishedPulling="2026-05-27 01:59:16.452758609 +0000 UTC m=+21.537096882" observedRunningTime="2026-05-27 01:59:24.745586743 +0000 UTC m=+29.829925025" watchObservedRunningTime="2026-05-27 01:59:24.775264192 +0000 UTC m=+29.859602505"
May 27 01:59:24.972506 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:24.972326    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:24.972506 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.972462    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 01:59:24.972701 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:24.972536    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret podName:2c1a212b-da65-402f-a034-be00e61f3e56 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:25.972515074 +0000 UTC m=+31.056853337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret") pod "global-pull-secret-syncer-pswlj" (UID: "2c1a212b-da65-402f-a034-be00e61f3e56") : object "kube-system"/"original-pull-secret" not registered
May 27 01:59:25.982740 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:25.982712    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:25.983339 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:25.982818    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 01:59:25.983339 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:25.982871    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret podName:2c1a212b-da65-402f-a034-be00e61f3e56 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:27.98285528 +0000 UTC m=+33.067193541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret") pod "global-pull-secret-syncer-pswlj" (UID: "2c1a212b-da65-402f-a034-be00e61f3e56") : object "kube-system"/"original-pull-secret" not registered
May 27 01:59:26.544031 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:26.544003    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:26.544031 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:26.544033    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:26.544210 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:26.544108    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:26.544210 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:26.544157    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:26.544299 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:26.544262    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:26.544378 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:26.544340    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pswlj" podUID="2c1a212b-da65-402f-a034-be00e61f3e56"
May 27 01:59:27.997091 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:27.997050    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:27.997645 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:27.997202    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 01:59:27.997645 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:27.997274    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret podName:2c1a212b-da65-402f-a034-be00e61f3e56 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:31.997252861 +0000 UTC m=+37.081591183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret") pod "global-pull-secret-syncer-pswlj" (UID: "2c1a212b-da65-402f-a034-be00e61f3e56") : object "kube-system"/"original-pull-secret" not registered
May 27 01:59:28.544370 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:28.544325    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:28.544535 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:28.544401    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:28.544535 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:28.544428    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:28.544637 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:28.544540    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pswlj" podUID="2c1a212b-da65-402f-a034-be00e61f3e56"
May 27 01:59:28.544637 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:28.544583    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kk9c7" podUID="ee6567a5-1576-4ea7-b9eb-d771924c8967"
May 27 01:59:28.544779 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:28.544672    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 01:59:29.195044 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.195014    2546 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeReady"
May 27 01:59:29.195426 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.195142    2546 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 01:59:29.206618 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.206592    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:29.206733 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.206690    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:29.206774 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.206735    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 02:00:01.206721784 +0000 UTC m=+66.291060044 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:29.239142 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.239118    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d729j"]
May 27 01:59:29.258024 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.258004    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gf8zq"]
May 27 01:59:29.258176 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.258149    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.260313 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.260291    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 01:59:29.260450 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.260387    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ngvd\""
May 27 01:59:29.260450 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.260426    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 01:59:29.277046 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.277026    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d729j"]
May 27 01:59:29.277046 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.277045    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gf8zq"]
May 27 01:59:29.277154 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.277122    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:29.279666 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.279650    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tmrqj\""
May 27 01:59:29.279763 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.279745    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 01:59:29.279836 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.279778    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 01:59:29.279891 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.279781    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 01:59:29.307543 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.307521    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:29.307629 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.307612    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:29.307629 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.307625    2546 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:29.307695 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.307633    2546 projected.go:194] Error preparing data for projected volume kube-api-access-7tv8d for pod openshift-network-diagnostics/network-check-target-kk9c7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:29.307695 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.307681    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d podName:ee6567a5-1576-4ea7-b9eb-d771924c8967 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:01.307669775 +0000 UTC m=+66.392008035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tv8d" (UniqueName: "kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d") pod "network-check-target-kk9c7" (UID: "ee6567a5-1576-4ea7-b9eb-d771924c8967") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:29.408471 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.408450    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.408558 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.408485    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1f1468a-efa4-4fa7-a799-10bb8c650a84-config-volume\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.408558 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.408515    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:29.408558 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.408549    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f1468a-efa4-4fa7-a799-10bb8c650a84-tmp-dir\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.408655 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.408567    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b7jz\" (UniqueName: \"kubernetes.io/projected/e57004c2-92ef-468f-8f1e-a2312230a5e7-kube-api-access-6b7jz\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:29.408655 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.408597    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsbwn\" (UniqueName: \"kubernetes.io/projected/d1f1468a-efa4-4fa7-a799-10bb8c650a84-kube-api-access-wsbwn\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.508994 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.508945    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsbwn\" (UniqueName: \"kubernetes.io/projected/d1f1468a-efa4-4fa7-a799-10bb8c650a84-kube-api-access-wsbwn\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.508994 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.508981    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.509116 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.509010    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1f1468a-efa4-4fa7-a799-10bb8c650a84-config-volume\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.509116 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.509083    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:29.509180 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.509129    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:30.009116324 +0000 UTC m=+35.093454597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 01:59:29.509229 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.509192    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:29.509264 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.509227    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f1468a-efa4-4fa7-a799-10bb8c650a84-tmp-dir\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.509264 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.509256    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b7jz\" (UniqueName: \"kubernetes.io/projected/e57004c2-92ef-468f-8f1e-a2312230a5e7-kube-api-access-6b7jz\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:29.509333 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.509309    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:29.509393 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:29.509381    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:30.009342412 +0000 UTC m=+35.093680674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 01:59:29.509553 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.509534    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1f1468a-efa4-4fa7-a799-10bb8c650a84-config-volume\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.509590 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.509539    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f1468a-efa4-4fa7-a799-10bb8c650a84-tmp-dir\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.520322 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.520203    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsbwn\" (UniqueName: \"kubernetes.io/projected/d1f1468a-efa4-4fa7-a799-10bb8c650a84-kube-api-access-wsbwn\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:29.520592 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:29.520573    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b7jz\" (UniqueName: \"kubernetes.io/projected/e57004c2-92ef-468f-8f1e-a2312230a5e7-kube-api-access-6b7jz\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:30.013604 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.013573    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:30.013737 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.013629    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:30.013737 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:30.013710    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:30.013737 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:30.013720    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:30.013829 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:30.013759    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:31.013746419 +0000 UTC m=+36.098084680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 01:59:30.013829 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:30.013778    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:31.013763808 +0000 UTC m=+36.098102069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 01:59:30.544077 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.544032    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:30.544077 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.544078    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 01:59:30.544692 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.544281    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 01:59:30.546796 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.546778    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 01:59:30.547829 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.547796    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 01:59:30.547952 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.547834    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 01:59:30.547952 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.547864    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9d6nl\""
May 27 01:59:30.547952 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.547843    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kwv6g\""
May 27 01:59:30.547952 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.547842    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 01:59:30.722946 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.722916    2546 generic.go:358] "Generic (PLEG): container finished" podID="654c5a26-d73f-42b0-b44f-8e76e6b56685" containerID="5fafd01d9bb08f7952cea34b388bc6eb52bbf2f34ed9a6fd782ebb73d6621c07" exitCode=0
May 27 01:59:30.723075 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:30.722983    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n84kv" event={"ID":"654c5a26-d73f-42b0-b44f-8e76e6b56685","Type":"ContainerDied","Data":"5fafd01d9bb08f7952cea34b388bc6eb52bbf2f34ed9a6fd782ebb73d6621c07"}
May 27 01:59:31.020430 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:31.020404    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:31.020545 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:31.020470    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:31.020585 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:31.020549    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:31.020585 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:31.020561    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:31.020644 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:31.020605    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:33.020592273 +0000 UTC m=+38.104930534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 01:59:31.020644 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:31.020639    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:33.020625483 +0000 UTC m=+38.104963747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 01:59:31.728543 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:31.728512    2546 generic.go:358] "Generic (PLEG): container finished" podID="654c5a26-d73f-42b0-b44f-8e76e6b56685" containerID="d7045ea5165b2e3a6b058e09998cfbcc48f0305c5be40fc036d1b4e04dc9899e" exitCode=0
May 27 01:59:31.728964 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:31.728568    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n84kv" event={"ID":"654c5a26-d73f-42b0-b44f-8e76e6b56685","Type":"ContainerDied","Data":"d7045ea5165b2e3a6b058e09998cfbcc48f0305c5be40fc036d1b4e04dc9899e"}
May 27 01:59:32.027980 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:32.027912    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:32.031064 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:32.031041    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c1a212b-da65-402f-a034-be00e61f3e56-original-pull-secret\") pod \"global-pull-secret-syncer-pswlj\" (UID: \"2c1a212b-da65-402f-a034-be00e61f3e56\") " pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:32.055084 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:32.055065    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pswlj"
May 27 01:59:32.205169 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:32.204965    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pswlj"]
May 27 01:59:32.209813 ip-10-0-142-84 kubenswrapper[2546]: W0527 01:59:32.209782    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1a212b_da65_402f_a034_be00e61f3e56.slice/crio-48064fd4adbc5ac76dbd8e783185c177002b5808211245c12d6d29673195c398 WatchSource:0}: Error finding container 48064fd4adbc5ac76dbd8e783185c177002b5808211245c12d6d29673195c398: Status 404 returned error can't find the container with id 48064fd4adbc5ac76dbd8e783185c177002b5808211245c12d6d29673195c398
May 27 01:59:32.731399 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:32.731361    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pswlj" event={"ID":"2c1a212b-da65-402f-a034-be00e61f3e56","Type":"ContainerStarted","Data":"48064fd4adbc5ac76dbd8e783185c177002b5808211245c12d6d29673195c398"}
May 27 01:59:32.734617 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:32.734590    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n84kv" event={"ID":"654c5a26-d73f-42b0-b44f-8e76e6b56685","Type":"ContainerStarted","Data":"5e586317801a1ec97936bc42c442e6b6f359363b5c92a6fa9eb8fa6279105609"}
May 27 01:59:32.757303 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:32.757260    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n84kv" podStartSLOduration=6.183498431 podStartE2EDuration="37.757247786s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 01:58:58.077631847 +0000 UTC m=+3.161970106" lastFinishedPulling="2026-05-27 01:59:29.651381186 +0000 UTC m=+34.735719461" observedRunningTime="2026-05-27 01:59:32.756193494 +0000 UTC m=+37.840531777" watchObservedRunningTime="2026-05-27 01:59:32.757247786 +0000 UTC m=+37.841586068"
May 27 01:59:33.036502 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:33.036421    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:33.036502 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:33.036492    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:33.036710 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:33.036579    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:33.036710 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:33.036603    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:33.036710 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:33.036668    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:37.036649776 +0000 UTC m=+42.120988050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 01:59:33.036710 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:33.036688    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:37.036678382 +0000 UTC m=+42.121016645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 01:59:36.743817 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:36.743770    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pswlj" event={"ID":"2c1a212b-da65-402f-a034-be00e61f3e56","Type":"ContainerStarted","Data":"85fbdaa5044529813af4f6f277a82ba0efbad8f8fa61cab94d796263fb1385aa"}
May 27 01:59:36.761455 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:36.761400    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pswlj" podStartSLOduration=8.937890218 podStartE2EDuration="12.761384642s" podCreationTimestamp="2026-05-27 01:59:24 +0000 UTC" firstStartedPulling="2026-05-27 01:59:32.211596985 +0000 UTC m=+37.295935248" lastFinishedPulling="2026-05-27 01:59:36.035091411 +0000 UTC m=+41.119429672" observedRunningTime="2026-05-27 01:59:36.760107876 +0000 UTC m=+41.844446177" watchObservedRunningTime="2026-05-27 01:59:36.761384642 +0000 UTC m=+41.845722923"
May 27 01:59:37.068216 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:37.068188    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:37.068409 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:37.068273    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:37.068409 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:37.068326    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:37.068409 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:37.068407    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:45.068391594 +0000 UTC m=+50.152729858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 01:59:37.068590 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:37.068420    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:37.068590 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:37.068489    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:45.068470621 +0000 UTC m=+50.152808884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 01:59:45.118035 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:45.117994    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 01:59:45.118481 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:45.118052    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 01:59:45.118481 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:45.118139    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:45.118481 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:45.118140    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:45.118481 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:45.118199    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:01.118184619 +0000 UTC m=+66.202522878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 01:59:45.118481 ip-10-0-142-84 kubenswrapper[2546]: E0527 01:59:45.118213    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:01.118206607 +0000 UTC m=+66.202544866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 01:59:56.724407 ip-10-0-142-84 kubenswrapper[2546]: I0527 01:59:56.724375    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rk7n"
May 27 02:00:01.120847 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.120800    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 02:00:01.121269 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.120876    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 02:00:01.121269 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:01.120965    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 02:00:01.121269 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:01.121024    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:33.121008521 +0000 UTC m=+98.205346780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 02:00:01.121269 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:01.120965    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 02:00:01.121269 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:01.121087    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:33.121074182 +0000 UTC m=+98.205412450 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 02:00:01.221252 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.221217    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 02:00:01.223946 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.223925    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 02:00:01.232039 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:01.232019    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 02:00:01.232119 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:01.232070    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 02:01:05.232056071 +0000 UTC m=+130.316394331 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : secret "metrics-daemon-secret" not found
May 27 02:00:01.321724 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.321694    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 02:00:01.324260 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.324242    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 02:00:01.334884 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.334866    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 02:00:01.346241 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.346213    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/ee6567a5-1576-4ea7-b9eb-d771924c8967-kube-api-access-7tv8d\") pod \"network-check-target-kk9c7\" (UID: \"ee6567a5-1576-4ea7-b9eb-d771924c8967\") " pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 02:00:01.463512 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.463431    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kwv6g\""
May 27 02:00:01.471564 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.471546    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 02:00:01.591962 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.591867    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kk9c7"]
May 27 02:00:01.594530 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:00:01.594495    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6567a5_1576_4ea7_b9eb_d771924c8967.slice/crio-5e1875ab0b299fca75c8c086b1996f74ae849ae40640e698d0a3f61b5420e1e2 WatchSource:0}: Error finding container 5e1875ab0b299fca75c8c086b1996f74ae849ae40640e698d0a3f61b5420e1e2: Status 404 returned error can't find the container with id 5e1875ab0b299fca75c8c086b1996f74ae849ae40640e698d0a3f61b5420e1e2
May 27 02:00:01.789981 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:01.789915    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kk9c7" event={"ID":"ee6567a5-1576-4ea7-b9eb-d771924c8967","Type":"ContainerStarted","Data":"5e1875ab0b299fca75c8c086b1996f74ae849ae40640e698d0a3f61b5420e1e2"}
May 27 02:00:04.797033 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:04.796949    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kk9c7" event={"ID":"ee6567a5-1576-4ea7-b9eb-d771924c8967","Type":"ContainerStarted","Data":"972d1eb1415f936c9f1c50bebf9a8ec7c5810a6f2ea7f119b37b622d4f0c3236"}
May 27 02:00:04.797397 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:04.797113    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 02:00:04.813065 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:04.813018    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kk9c7" podStartSLOduration=66.910312216 podStartE2EDuration="1m9.813004399s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 02:00:01.596398178 +0000 UTC m=+66.680736438" lastFinishedPulling="2026-05-27 02:00:04.499090361 +0000 UTC m=+69.583428621" observedRunningTime="2026-05-27 02:00:04.812201899 +0000 UTC m=+69.896540182" watchObservedRunningTime="2026-05-27 02:00:04.813004399 +0000 UTC m=+69.897342678"
May 27 02:00:33.122166 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:33.122125    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 02:00:33.122658 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:33.122182    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 02:00:33.122658 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:33.122265    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 02:00:33.122658 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:33.122269    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 02:00:33.122658 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:33.122324    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:37.122309711 +0000 UTC m=+162.206647972 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 02:00:33.122658 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:00:33.122336    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:37.122330809 +0000 UTC m=+162.206669069 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 02:00:35.801470 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:00:35.801442    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kk9c7"
May 27 02:01:05.331984 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:05.331938    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 02:01:05.332549 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:05.332107    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 02:01:05.332549 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:05.332203    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs podName:6ae416e9-a5f3-4e13-b60f-f60797baf9ae nodeName:}" failed. No retries permitted until 2026-05-27 02:03:07.332184727 +0000 UTC m=+252.416522987 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs") pod "network-metrics-daemon-zdfpv" (UID: "6ae416e9-a5f3-4e13-b60f-f60797baf9ae") : secret "metrics-daemon-secret" not found
May 27 02:01:25.267750 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.267711    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"]
May 27 02:01:25.270779 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.270751    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.273700 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.273661    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kbqks\""
May 27 02:01:25.273933 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.273909    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 27 02:01:25.274784 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.274761    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 27 02:01:25.274914 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.274765    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 27 02:01:25.274914 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.274853    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 27 02:01:25.284040 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.284012    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"]
May 27 02:01:25.362191 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.362165    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"]
May 27 02:01:25.362404 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.362384    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5050292-e23b-4e71-86ba-9f651f950347-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.362478 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.362455    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5050292-e23b-4e71-86ba-9f651f950347-config\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.362522 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.362493    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktv45\" (UniqueName: \"kubernetes.io/projected/f5050292-e23b-4e71-86ba-9f651f950347-kube-api-access-ktv45\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.365054 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.365039    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.366591 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.366567    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"]
May 27 02:01:25.368265 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.368244    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-snrpz\""
May 27 02:01:25.368362 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.368303    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 27 02:01:25.369163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.369146    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.369922 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.369904    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 02:01:25.370010 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.369938    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 02:01:25.370010 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.369954    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 27 02:01:25.380699 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.380680    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 27 02:01:25.380930 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.380909    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 27 02:01:25.380930 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.380925    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 27 02:01:25.381150 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.381135    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jxctn\""
May 27 02:01:25.381183 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.381164    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 27 02:01:25.388127 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.388107    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"]
May 27 02:01:25.396841 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.396822    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"]
May 27 02:01:25.463761 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.463741    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.463869 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.463786    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.463869 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.463853    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5050292-e23b-4e71-86ba-9f651f950347-config\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.463952 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.463881    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/631d8adb-7415-42da-9494-5a1d17471847-serving-cert\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.463952 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.463910    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktv45\" (UniqueName: \"kubernetes.io/projected/f5050292-e23b-4e71-86ba-9f651f950347-kube-api-access-ktv45\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.463952 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.463933    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/631d8adb-7415-42da-9494-5a1d17471847-config\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.464096 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.463964    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4n5p\" (UniqueName: \"kubernetes.io/projected/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-kube-api-access-b4n5p\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.464096 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.463980    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cngp8\" (UniqueName: \"kubernetes.io/projected/631d8adb-7415-42da-9494-5a1d17471847-kube-api-access-cngp8\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.464096 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.464021    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5050292-e23b-4e71-86ba-9f651f950347-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.464395 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.464376    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5050292-e23b-4e71-86ba-9f651f950347-config\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.466294 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.466276    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5050292-e23b-4e71-86ba-9f651f950347-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.478296 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.478277    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55cf9d8586-5npg6"]
May 27 02:01:25.481003 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.480984    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.484768 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.484749    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 27 02:01:25.484941 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.484923    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 27 02:01:25.485363 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.485325    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6f88x\""
May 27 02:01:25.485471 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.485329    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 27 02:01:25.485471 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.485457    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 27 02:01:25.485708 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.485683    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 27 02:01:25.485800 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.485711    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 27 02:01:25.487896 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.487872    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktv45\" (UniqueName: \"kubernetes.io/projected/f5050292-e23b-4e71-86ba-9f651f950347-kube-api-access-ktv45\") pod \"kube-storage-version-migrator-operator-565644f49-v8spg\" (UID: \"f5050292-e23b-4e71-86ba-9f651f950347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.497231 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.497211    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55cf9d8586-5npg6"]
May 27 02:01:25.564752 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564734    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-default-certificate\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.564837 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564771    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4n5p\" (UniqueName: \"kubernetes.io/projected/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-kube-api-access-b4n5p\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.564837 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564790    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cngp8\" (UniqueName: \"kubernetes.io/projected/631d8adb-7415-42da-9494-5a1d17471847-kube-api-access-cngp8\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.564837 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564809    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.564837 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564828    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.565016 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564847    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.565016 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564871    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.565016 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564899    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/631d8adb-7415-42da-9494-5a1d17471847-serving-cert\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.565016 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564929    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/631d8adb-7415-42da-9494-5a1d17471847-config\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.565016 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564965    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-stats-auth\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.565016 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.564992    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp95j\" (UniqueName: \"kubernetes.io/projected/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-kube-api-access-mp95j\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.565308 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:25.565067    2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 02:01:25.565308 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:25.565142    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls podName:4121ffb1-5942-4528-99cc-1a3cb9dcabd1 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:26.065117081 +0000 UTC m=+151.149455342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h52js" (UID: "4121ffb1-5942-4528-99cc-1a3cb9dcabd1") : secret "cluster-monitoring-operator-tls" not found
May 27 02:01:25.565456 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.565402    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/631d8adb-7415-42da-9494-5a1d17471847-config\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.565692 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.565672    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.567163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.567144    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/631d8adb-7415-42da-9494-5a1d17471847-serving-cert\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.575015 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.574988    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cngp8\" (UniqueName: \"kubernetes.io/projected/631d8adb-7415-42da-9494-5a1d17471847-kube-api-access-cngp8\") pod \"service-ca-operator-57b5b68b8-wpmsc\" (UID: \"631d8adb-7415-42da-9494-5a1d17471847\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.580237 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.580211    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4n5p\" (UniqueName: \"kubernetes.io/projected/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-kube-api-access-b4n5p\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:25.580342 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.580291    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"
May 27 02:01:25.665854 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.665831    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.665953 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.665863    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.665953 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.665916    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-stats-auth\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.665953 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.665933    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mp95j\" (UniqueName: \"kubernetes.io/projected/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-kube-api-access-mp95j\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.665953 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.665953    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-default-certificate\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.666143 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:25.666097    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:26.166063015 +0000 UTC m=+151.250401296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : configmap references non-existent config key: service-ca.crt
May 27 02:01:25.666318 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:25.666281    2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 02:01:25.666450 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:25.666366    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:26.16633124 +0000 UTC m=+151.250669516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : secret "router-metrics-certs-default" not found
May 27 02:01:25.668515 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.668480    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-default-certificate\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.668720 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.668680    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-stats-auth\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.675152 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.675133    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp95j\" (UniqueName: \"kubernetes.io/projected/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-kube-api-access-mp95j\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:25.679490 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.679474    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"
May 27 02:01:25.700775 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.700740    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg"]
May 27 02:01:25.705028 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:01:25.705004    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5050292_e23b_4e71_86ba_9f651f950347.slice/crio-caa219aa18f1c706e0628825a27437c9bf69733382b71f3d275460315cf4817e WatchSource:0}: Error finding container caa219aa18f1c706e0628825a27437c9bf69733382b71f3d275460315cf4817e: Status 404 returned error can't find the container with id caa219aa18f1c706e0628825a27437c9bf69733382b71f3d275460315cf4817e
May 27 02:01:25.804766 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.804738    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc"]
May 27 02:01:25.807490 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:01:25.807464    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631d8adb_7415_42da_9494_5a1d17471847.slice/crio-7d16a5b6727fc024a788dcc1480b8e6e270dddbc55b1888d76a15c90530778ea WatchSource:0}: Error finding container 7d16a5b6727fc024a788dcc1480b8e6e270dddbc55b1888d76a15c90530778ea: Status 404 returned error can't find the container with id 7d16a5b6727fc024a788dcc1480b8e6e270dddbc55b1888d76a15c90530778ea
May 27 02:01:25.946208 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.946147    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg" event={"ID":"f5050292-e23b-4e71-86ba-9f651f950347","Type":"ContainerStarted","Data":"caa219aa18f1c706e0628825a27437c9bf69733382b71f3d275460315cf4817e"}
May 27 02:01:25.947126 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:25.947103    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc" event={"ID":"631d8adb-7415-42da-9494-5a1d17471847","Type":"ContainerStarted","Data":"7d16a5b6727fc024a788dcc1480b8e6e270dddbc55b1888d76a15c90530778ea"}
May 27 02:01:26.068619 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:26.068591    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:26.068762 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:26.068742    2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 02:01:26.068838 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:26.068826    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls podName:4121ffb1-5942-4528-99cc-1a3cb9dcabd1 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:27.068809187 +0000 UTC m=+152.153147446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h52js" (UID: "4121ffb1-5942-4528-99cc-1a3cb9dcabd1") : secret "cluster-monitoring-operator-tls" not found
May 27 02:01:26.169732 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:26.169693    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:26.169732 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:26.169731    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:26.169885 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:26.169872    2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 02:01:26.169927 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:26.169873    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:27.16985605 +0000 UTC m=+152.254194310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : configmap references non-existent config key: service-ca.crt
May 27 02:01:26.169972 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:26.169946    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:27.169926391 +0000 UTC m=+152.254264656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : secret "router-metrics-certs-default" not found
May 27 02:01:27.077849 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:27.077803    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:27.078225 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:27.077942    2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 02:01:27.078225 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:27.078006    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls podName:4121ffb1-5942-4528-99cc-1a3cb9dcabd1 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:29.077988403 +0000 UTC m=+154.162326663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h52js" (UID: "4121ffb1-5942-4528-99cc-1a3cb9dcabd1") : secret "cluster-monitoring-operator-tls" not found
May 27 02:01:27.179071 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:27.179037    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:27.179071 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:27.179068    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:27.179266 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:27.179185    2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 02:01:27.179266 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:27.179219    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:29.179198905 +0000 UTC m=+154.263537182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : configmap references non-existent config key: service-ca.crt
May 27 02:01:27.179266 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:27.179246    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:29.179235426 +0000 UTC m=+154.263573690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : secret "router-metrics-certs-default" not found
May 27 02:01:28.954630 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:28.954556    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg" event={"ID":"f5050292-e23b-4e71-86ba-9f651f950347","Type":"ContainerStarted","Data":"9143f9593fe8b1beb6f29acace5210aa0d2efcb9ebc7fcf6139aa056b7836ddb"}
May 27 02:01:28.955894 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:28.955857    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc" event={"ID":"631d8adb-7415-42da-9494-5a1d17471847","Type":"ContainerStarted","Data":"b8678657468d69e1821f245f47bf28ec8cfce41d3a8da6bd030e79baefb93713"}
May 27 02:01:28.970844 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:28.970798    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg" podStartSLOduration=1.095971138 podStartE2EDuration="3.970786162s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="2026-05-27 02:01:25.706836778 +0000 UTC m=+150.791175041" lastFinishedPulling="2026-05-27 02:01:28.581651805 +0000 UTC m=+153.665990065" observedRunningTime="2026-05-27 02:01:28.970175777 +0000 UTC m=+154.054514060" watchObservedRunningTime="2026-05-27 02:01:28.970786162 +0000 UTC m=+154.055124444"
May 27 02:01:28.984940 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:28.984892    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc" podStartSLOduration=1.214110743 podStartE2EDuration="3.984878082s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="2026-05-27 02:01:25.809177922 +0000 UTC m=+150.893516182" lastFinishedPulling="2026-05-27 02:01:28.579945246 +0000 UTC m=+153.664283521" observedRunningTime="2026-05-27 02:01:28.984622899 +0000 UTC m=+154.068961181" watchObservedRunningTime="2026-05-27 02:01:28.984878082 +0000 UTC m=+154.069216368"
May 27 02:01:29.093448 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:29.093427    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:29.093589 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:29.093564    2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 02:01:29.093643 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:29.093621    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls podName:4121ffb1-5942-4528-99cc-1a3cb9dcabd1 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:33.093606322 +0000 UTC m=+158.177944582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h52js" (UID: "4121ffb1-5942-4528-99cc-1a3cb9dcabd1") : secret "cluster-monitoring-operator-tls" not found
May 27 02:01:29.194543 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:29.194514    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:29.194543 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:29.194541    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:29.194704 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:29.194651    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:33.194636058 +0000 UTC m=+158.278974334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : configmap references non-existent config key: service-ca.crt
May 27 02:01:29.194704 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:29.194664    2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 02:01:29.194704 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:29.194697    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:33.194685609 +0000 UTC m=+158.279023874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : secret "router-metrics-certs-default" not found
May 27 02:01:31.551363 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:31.551319    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxkhd_ebdb4199-7ea7-42c4-8c69-ba63d7049d8e/dns-node-resolver/0.log"
May 27 02:01:32.267762 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:32.267721    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d729j" podUID="d1f1468a-efa4-4fa7-a799-10bb8c650a84"
May 27 02:01:32.285035 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:32.285003    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-gf8zq" podUID="e57004c2-92ef-468f-8f1e-a2312230a5e7"
May 27 02:01:32.352047 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.352020    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bbwkl_6eedf9d0-32bb-47c6-8205-8e53b3a43ded/node-ca/0.log"
May 27 02:01:32.445657 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.445626    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-t5zw4"]
May 27 02:01:32.449769 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.449752    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.452696 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.452670    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 27 02:01:32.452820 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.452670    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 27 02:01:32.452820 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.452673    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-p4dtj\""
May 27 02:01:32.453553 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.453535    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 27 02:01:32.453553 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.453549    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 27 02:01:32.456460 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.456280    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-t5zw4"]
May 27 02:01:32.621831 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.621808    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45e7724a-5718-4a91-ae35-53926da3b2f5-signing-cabundle\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.622143 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.621847    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45e7724a-5718-4a91-ae35-53926da3b2f5-signing-key\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.622143 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.621967    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl78q\" (UniqueName: \"kubernetes.io/projected/45e7724a-5718-4a91-ae35-53926da3b2f5-kube-api-access-nl78q\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.722471 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.722443    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl78q\" (UniqueName: \"kubernetes.io/projected/45e7724a-5718-4a91-ae35-53926da3b2f5-kube-api-access-nl78q\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.722562 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.722488    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45e7724a-5718-4a91-ae35-53926da3b2f5-signing-cabundle\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.722562 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.722516    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45e7724a-5718-4a91-ae35-53926da3b2f5-signing-key\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.723120 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.723086    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45e7724a-5718-4a91-ae35-53926da3b2f5-signing-cabundle\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.725243 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.725211    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45e7724a-5718-4a91-ae35-53926da3b2f5-signing-key\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.731482 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.731457    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl78q\" (UniqueName: \"kubernetes.io/projected/45e7724a-5718-4a91-ae35-53926da3b2f5-kube-api-access-nl78q\") pod \"service-ca-67d667c7d-t5zw4\" (UID: \"45e7724a-5718-4a91-ae35-53926da3b2f5\") " pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.759549 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.759522    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-t5zw4"
May 27 02:01:32.880937 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.880864    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-t5zw4"]
May 27 02:01:32.884794 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:01:32.884752    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e7724a_5718_4a91_ae35_53926da3b2f5.slice/crio-408cee7f6c9c454b4b0d60649f9f5eb1702573e8b58127aa79e01af616dba959 WatchSource:0}: Error finding container 408cee7f6c9c454b4b0d60649f9f5eb1702573e8b58127aa79e01af616dba959: Status 404 returned error can't find the container with id 408cee7f6c9c454b4b0d60649f9f5eb1702573e8b58127aa79e01af616dba959
May 27 02:01:32.965439 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.965419    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d729j"
May 27 02:01:32.965542 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.965415    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-t5zw4" event={"ID":"45e7724a-5718-4a91-ae35-53926da3b2f5","Type":"ContainerStarted","Data":"e7de797ee126092303387a78e9be9b509f317de8c2b71bb85136cc9bcff8fcce"}
May 27 02:01:32.965614 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.965549    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-t5zw4" event={"ID":"45e7724a-5718-4a91-ae35-53926da3b2f5","Type":"ContainerStarted","Data":"408cee7f6c9c454b4b0d60649f9f5eb1702573e8b58127aa79e01af616dba959"}
May 27 02:01:32.984205 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:32.984167    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-t5zw4" podStartSLOduration=0.984153913 podStartE2EDuration="984.153913ms" podCreationTimestamp="2026-05-27 02:01:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:01:32.983623532 +0000 UTC m=+158.067961815" watchObservedRunningTime="2026-05-27 02:01:32.984153913 +0000 UTC m=+158.068492195"
May 27 02:01:33.125299 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:33.125183    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:33.125422 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:33.125371    2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 02:01:33.125509 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:33.125438    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls podName:4121ffb1-5942-4528-99cc-1a3cb9dcabd1 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:41.125418575 +0000 UTC m=+166.209756835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h52js" (UID: "4121ffb1-5942-4528-99cc-1a3cb9dcabd1") : secret "cluster-monitoring-operator-tls" not found
May 27 02:01:33.225501 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:33.225453    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:33.225501 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:33.225478    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:33.225614 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:33.225572    2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 02:01:33.225614 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:33.225613    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:41.225599478 +0000 UTC m=+166.309937740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : secret "router-metrics-certs-default" not found
May 27 02:01:33.225681 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:33.225627    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle podName:f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:41.225619482 +0000 UTC m=+166.309957742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle") pod "router-default-55cf9d8586-5npg6" (UID: "f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3") : configmap references non-existent config key: service-ca.crt
May 27 02:01:33.565755 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:33.565734    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zdfpv" podUID="6ae416e9-a5f3-4e13-b60f-f60797baf9ae"
May 27 02:01:37.155561 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:37.155526    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 02:01:37.156107 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:37.155632    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 02:01:37.156107 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:37.155659    2546 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 02:01:37.156107 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:37.155720    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert podName:e57004c2-92ef-468f-8f1e-a2312230a5e7 nodeName:}" failed. No retries permitted until 2026-05-27 02:03:39.155704256 +0000 UTC m=+284.240042516 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert") pod "ingress-canary-gf8zq" (UID: "e57004c2-92ef-468f-8f1e-a2312230a5e7") : secret "canary-serving-cert" not found
May 27 02:01:37.156107 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:37.155772    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 02:01:37.156107 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:37.155831    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls podName:d1f1468a-efa4-4fa7-a799-10bb8c650a84 nodeName:}" failed. No retries permitted until 2026-05-27 02:03:39.155815183 +0000 UTC m=+284.240153442 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls") pod "dns-default-d729j" (UID: "d1f1468a-efa4-4fa7-a799-10bb8c650a84") : secret "dns-default-metrics-tls" not found
May 27 02:01:41.187060 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.187028    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:41.187555 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:41.187181    2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 02:01:41.187555 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:01:41.187267    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls podName:4121ffb1-5942-4528-99cc-1a3cb9dcabd1 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:57.187235823 +0000 UTC m=+182.271574092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h52js" (UID: "4121ffb1-5942-4528-99cc-1a3cb9dcabd1") : secret "cluster-monitoring-operator-tls" not found
May 27 02:01:41.287763 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.287732    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:41.287763 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.287764    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:41.288304 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.288282    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-service-ca-bundle\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:41.290267 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.290243    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3-metrics-certs\") pod \"router-default-55cf9d8586-5npg6\" (UID: \"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3\") " pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:41.394223 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.394202    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:41.521932 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.521902    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55cf9d8586-5npg6"]
May 27 02:01:41.525053 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:01:41.525022    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bbaa3b_6f34_4a09_8399_ffe11d73ebf3.slice/crio-ab5c9aefc921ece097869ebc12546c35441028161321093a3d09afd81ff88362 WatchSource:0}: Error finding container ab5c9aefc921ece097869ebc12546c35441028161321093a3d09afd81ff88362: Status 404 returned error can't find the container with id ab5c9aefc921ece097869ebc12546c35441028161321093a3d09afd81ff88362
May 27 02:01:41.995338 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.995307    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55cf9d8586-5npg6" event={"ID":"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3","Type":"ContainerStarted","Data":"a48d09c8ae60d1c234e38f184af5a79ec8e93a75804ebbdb09f68970209ee225"}
May 27 02:01:41.995338 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:41.995340    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55cf9d8586-5npg6" event={"ID":"f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3","Type":"ContainerStarted","Data":"ab5c9aefc921ece097869ebc12546c35441028161321093a3d09afd81ff88362"}
May 27 02:01:42.013764 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:42.013719    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-55cf9d8586-5npg6" podStartSLOduration=17.013705595 podStartE2EDuration="17.013705595s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:01:42.012999266 +0000 UTC m=+167.097337549" watchObservedRunningTime="2026-05-27 02:01:42.013705595 +0000 UTC m=+167.098043877"
May 27 02:01:42.394550 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:42.394525    2546 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:42.396765 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:42.396748    2546 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:42.999434 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:42.999405    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:43.000660 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:43.000633    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55cf9d8586-5npg6"
May 27 02:01:44.544365 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:44.544316    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 02:01:47.543726 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:47.543683    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 02:01:55.537590 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.537562    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ktj4s"]
May 27 02:01:55.542431 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.542411    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.546769 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.546746    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 02:01:55.546910 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.546748    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 02:01:55.547863 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.547631    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 02:01:55.547863 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.547695    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-62mqj\""
May 27 02:01:55.548202 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.547915    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 02:01:55.555502 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.555479    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ktj4s"]
May 27 02:01:55.647067 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.647043    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-795d4b9689-7gb52"]
May 27 02:01:55.650008 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.649994    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.652670 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.652647    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 02:01:55.652788 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.652689    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 02:01:55.652788 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.652656    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 02:01:55.652788 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.652656    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x7747\""
May 27 02:01:55.657607 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.657587    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 02:01:55.661766 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.661747    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795d4b9689-7gb52"]
May 27 02:01:55.686049 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.686025    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3faae558-918e-40c6-86e4-fd6d6eff006e-crio-socket\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.686133 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.686086    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3faae558-918e-40c6-86e4-fd6d6eff006e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.686133 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.686120    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3faae558-918e-40c6-86e4-fd6d6eff006e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.686206 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.686160    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvdr\" (UniqueName: \"kubernetes.io/projected/3faae558-918e-40c6-86e4-fd6d6eff006e-kube-api-access-zdvdr\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.686206 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.686179    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3faae558-918e-40c6-86e4-fd6d6eff006e-data-volume\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.786649 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786588    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-registry-tls\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.786649 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786618    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvdr\" (UniqueName: \"kubernetes.io/projected/3faae558-918e-40c6-86e4-fd6d6eff006e-kube-api-access-zdvdr\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.786649 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786638    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-trusted-ca\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.786812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786664    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3faae558-918e-40c6-86e4-fd6d6eff006e-data-volume\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.786812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786708    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-installation-pull-secrets\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.786812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786745    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-ca-trust-extracted\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.786812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786773    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-registry-certificates\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.786812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786796    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3faae558-918e-40c6-86e4-fd6d6eff006e-crio-socket\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.786987 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786821    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jlfx\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-kube-api-access-2jlfx\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.786987 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786849    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-bound-sa-token\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.786987 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786892    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3faae558-918e-40c6-86e4-fd6d6eff006e-crio-socket\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.786987 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786925    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3faae558-918e-40c6-86e4-fd6d6eff006e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.786987 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786959    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3faae558-918e-40c6-86e4-fd6d6eff006e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.787144 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.786933    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3faae558-918e-40c6-86e4-fd6d6eff006e-data-volume\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.787144 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.787003    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-image-registry-private-configuration\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.787385 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.787370    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3faae558-918e-40c6-86e4-fd6d6eff006e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.789254 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.789234    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3faae558-918e-40c6-86e4-fd6d6eff006e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.798699 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.798678    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvdr\" (UniqueName: \"kubernetes.io/projected/3faae558-918e-40c6-86e4-fd6d6eff006e-kube-api-access-zdvdr\") pod \"insights-runtime-extractor-ktj4s\" (UID: \"3faae558-918e-40c6-86e4-fd6d6eff006e\") " pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.852107 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.852089    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ktj4s"
May 27 02:01:55.887877 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.887851    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-image-registry-private-configuration\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.887987 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.887897    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-registry-tls\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.887987 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.887950    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-trusted-ca\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.888057 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.887987    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-installation-pull-secrets\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.888127 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.888107    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-ca-trust-extracted\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.888180 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.888141    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-registry-certificates\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.888234 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.888177    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jlfx\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-kube-api-access-2jlfx\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.888234 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.888209    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-bound-sa-token\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.888577 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.888552    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-ca-trust-extracted\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.889009 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.888985    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-trusted-ca\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.889516 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.889488    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-registry-certificates\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.890437 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.890414    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-installation-pull-secrets\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.890827 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.890805    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-image-registry-private-configuration\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.890935 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.890916    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-registry-tls\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.896826 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.896801    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-bound-sa-token\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.896903 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.896835    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jlfx\" (UniqueName: \"kubernetes.io/projected/3d6bdb31-c6e5-40c9-9275-b85e540df3ca-kube-api-access-2jlfx\") pod \"image-registry-795d4b9689-7gb52\" (UID: \"3d6bdb31-c6e5-40c9-9275-b85e540df3ca\") " pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.959298 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.959270    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:55.978785 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:55.978759    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ktj4s"]
May 27 02:01:55.981448 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:01:55.981422    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3faae558_918e_40c6_86e4_fd6d6eff006e.slice/crio-49734cbe24296522309de4d28abcbaf04a141d3ac107a3bb31c46c0afbc3f9a5 WatchSource:0}: Error finding container 49734cbe24296522309de4d28abcbaf04a141d3ac107a3bb31c46c0afbc3f9a5: Status 404 returned error can't find the container with id 49734cbe24296522309de4d28abcbaf04a141d3ac107a3bb31c46c0afbc3f9a5
May 27 02:01:56.032914 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:56.032888    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktj4s" event={"ID":"3faae558-918e-40c6-86e4-fd6d6eff006e","Type":"ContainerStarted","Data":"49734cbe24296522309de4d28abcbaf04a141d3ac107a3bb31c46c0afbc3f9a5"}
May 27 02:01:56.091881 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:56.091854    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795d4b9689-7gb52"]
May 27 02:01:56.094490 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:01:56.094467    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6bdb31_c6e5_40c9_9275_b85e540df3ca.slice/crio-f33b073355cfe4a739c536023a2a802a1db662bccb70cc612db97e1389be74ad WatchSource:0}: Error finding container f33b073355cfe4a739c536023a2a802a1db662bccb70cc612db97e1389be74ad: Status 404 returned error can't find the container with id f33b073355cfe4a739c536023a2a802a1db662bccb70cc612db97e1389be74ad
May 27 02:01:57.036754 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.036690    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktj4s" event={"ID":"3faae558-918e-40c6-86e4-fd6d6eff006e","Type":"ContainerStarted","Data":"4e355b1e9d0235a34508ae43a1031cab63825594973a47e06220da4ccc9a51e3"}
May 27 02:01:57.036754 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.036731    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktj4s" event={"ID":"3faae558-918e-40c6-86e4-fd6d6eff006e","Type":"ContainerStarted","Data":"916ea08d49f09b440d3bce444c587239fa842f743f79afd91474b4a13c5e12f0"}
May 27 02:01:57.037904 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.037875    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795d4b9689-7gb52" event={"ID":"3d6bdb31-c6e5-40c9-9275-b85e540df3ca","Type":"ContainerStarted","Data":"eb4d23121150b6c3f98a67c4ff32a7bda68fa654544c7d39682046074cd47df5"}
May 27 02:01:57.037994 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.037914    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795d4b9689-7gb52" event={"ID":"3d6bdb31-c6e5-40c9-9275-b85e540df3ca","Type":"ContainerStarted","Data":"f33b073355cfe4a739c536023a2a802a1db662bccb70cc612db97e1389be74ad"}
May 27 02:01:57.038043 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.038020    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:01:57.057749 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.057708    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-795d4b9689-7gb52" podStartSLOduration=2.057694622 podStartE2EDuration="2.057694622s" podCreationTimestamp="2026-05-27 02:01:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:01:57.056694213 +0000 UTC m=+182.141032495" watchObservedRunningTime="2026-05-27 02:01:57.057694622 +0000 UTC m=+182.142032940"
May 27 02:01:57.198420 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.198385    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:57.201008 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.200978    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4121ffb1-5942-4528-99cc-1a3cb9dcabd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h52js\" (UID: \"4121ffb1-5942-4528-99cc-1a3cb9dcabd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:57.477032 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.477008    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-snrpz\""
May 27 02:01:57.485095 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.485077    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"
May 27 02:01:57.629648 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:57.629615    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js"]
May 27 02:01:57.632729 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:01:57.632695    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4121ffb1_5942_4528_99cc_1a3cb9dcabd1.slice/crio-cae2c673c0e147f8688543ce91f1841ec7dbce8fe5f0b683fba92582f498cfbe WatchSource:0}: Error finding container cae2c673c0e147f8688543ce91f1841ec7dbce8fe5f0b683fba92582f498cfbe: Status 404 returned error can't find the container with id cae2c673c0e147f8688543ce91f1841ec7dbce8fe5f0b683fba92582f498cfbe
May 27 02:01:58.041706 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:58.041662    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js" event={"ID":"4121ffb1-5942-4528-99cc-1a3cb9dcabd1","Type":"ContainerStarted","Data":"cae2c673c0e147f8688543ce91f1841ec7dbce8fe5f0b683fba92582f498cfbe"}
May 27 02:01:59.045563 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:59.045522    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktj4s" event={"ID":"3faae558-918e-40c6-86e4-fd6d6eff006e","Type":"ContainerStarted","Data":"63cfd5994718b68a6df2213135686c6ebc76410b237a1bec21704a1b82098e81"}
May 27 02:01:59.063843 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:01:59.063791    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ktj4s" podStartSLOduration=2.044885792 podStartE2EDuration="4.063777202s" podCreationTimestamp="2026-05-27 02:01:55 +0000 UTC" firstStartedPulling="2026-05-27 02:01:56.051264126 +0000 UTC m=+181.135602385" lastFinishedPulling="2026-05-27 02:01:58.070155535 +0000 UTC m=+183.154493795" observedRunningTime="2026-05-27 02:01:59.06309872 +0000 UTC m=+184.147437001" watchObservedRunningTime="2026-05-27 02:01:59.063777202 +0000 UTC m=+184.148115483"
May 27 02:02:00.049580 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.049500    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js" event={"ID":"4121ffb1-5942-4528-99cc-1a3cb9dcabd1","Type":"ContainerStarted","Data":"668e6682d772bc1b4f8dc487d8358bea03f5c4f9d2760d03e712d9771a167c53"}
May 27 02:02:00.071449 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.071405    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h52js" podStartSLOduration=33.05631858 podStartE2EDuration="35.07138969s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="2026-05-27 02:01:57.634919784 +0000 UTC m=+182.719258060" lastFinishedPulling="2026-05-27 02:01:59.649990893 +0000 UTC m=+184.734329170" observedRunningTime="2026-05-27 02:02:00.069919184 +0000 UTC m=+185.154257467" watchObservedRunningTime="2026-05-27 02:02:00.07138969 +0000 UTC m=+185.155727972"
May 27 02:02:00.158667 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.158644    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"]
May 27 02:02:00.161541 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.161525    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"
May 27 02:02:00.164390 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.164365    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4g58s\""
May 27 02:02:00.164390 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.164394    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 27 02:02:00.172493 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.172471    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"]
May 27 02:02:00.220277 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.220245    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/42cbce46-97d2-4dcf-bfc7-2b851246bf75-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb\" (UID: \"42cbce46-97d2-4dcf-bfc7-2b851246bf75\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"
May 27 02:02:00.321216 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.321197    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/42cbce46-97d2-4dcf-bfc7-2b851246bf75-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb\" (UID: \"42cbce46-97d2-4dcf-bfc7-2b851246bf75\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"
May 27 02:02:00.321323 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:02:00.321291    2546 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 27 02:02:00.321383 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:02:00.321339    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42cbce46-97d2-4dcf-bfc7-2b851246bf75-tls-certificates podName:42cbce46-97d2-4dcf-bfc7-2b851246bf75 nodeName:}" failed. No retries permitted until 2026-05-27 02:02:00.821325325 +0000 UTC m=+185.905663585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/42cbce46-97d2-4dcf-bfc7-2b851246bf75-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb" (UID: "42cbce46-97d2-4dcf-bfc7-2b851246bf75") : secret "prometheus-operator-admission-webhook-tls" not found
May 27 02:02:00.824515 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.824492    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/42cbce46-97d2-4dcf-bfc7-2b851246bf75-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb\" (UID: \"42cbce46-97d2-4dcf-bfc7-2b851246bf75\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"
May 27 02:02:00.826902 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:00.826875    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/42cbce46-97d2-4dcf-bfc7-2b851246bf75-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb\" (UID: \"42cbce46-97d2-4dcf-bfc7-2b851246bf75\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"
May 27 02:02:01.070430 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:01.070391    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"
May 27 02:02:01.196923 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:01.196893    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"]
May 27 02:02:01.201717 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:02:01.201684    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cbce46_97d2_4dcf_bfc7_2b851246bf75.slice/crio-5555a2cc48671d59701c6909f9c98f5aceae2432cbb9c7d7027dbc2f15052731 WatchSource:0}: Error finding container 5555a2cc48671d59701c6909f9c98f5aceae2432cbb9c7d7027dbc2f15052731: Status 404 returned error can't find the container with id 5555a2cc48671d59701c6909f9c98f5aceae2432cbb9c7d7027dbc2f15052731
May 27 02:02:02.055824 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:02.055787    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb" event={"ID":"42cbce46-97d2-4dcf-bfc7-2b851246bf75","Type":"ContainerStarted","Data":"5555a2cc48671d59701c6909f9c98f5aceae2432cbb9c7d7027dbc2f15052731"}
May 27 02:02:04.062195 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.062159    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb" event={"ID":"42cbce46-97d2-4dcf-bfc7-2b851246bf75","Type":"ContainerStarted","Data":"a4ddc43be47d2ac2cf3a8d9da4006f1e60a053d15765f6e69cfcd36c3dc5f178"}
May 27 02:02:04.062654 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.062391    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"
May 27 02:02:04.067486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.067465    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb"
May 27 02:02:04.079628 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.079577    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb" podStartSLOduration=1.968135395 podStartE2EDuration="4.079564613s" podCreationTimestamp="2026-05-27 02:02:00 +0000 UTC" firstStartedPulling="2026-05-27 02:02:01.203761208 +0000 UTC m=+186.288099469" lastFinishedPulling="2026-05-27 02:02:03.315190413 +0000 UTC m=+188.399528687" observedRunningTime="2026-05-27 02:02:04.078781839 +0000 UTC m=+189.163120122" watchObservedRunningTime="2026-05-27 02:02:04.079564613 +0000 UTC m=+189.163902896"
May 27 02:02:04.226863 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.226828    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"]
May 27 02:02:04.230035 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.230015    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.232888 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.232867    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 27 02:02:04.232998 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.232867    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 02:02:04.232998 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.232931    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8nv46\""
May 27 02:02:04.233100 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.233063    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 27 02:02:04.240953 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.240931    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"]
May 27 02:02:04.251268 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.251245    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49d7d747-4f22-4224-a5f4-e7995330a6ab-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.251376 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.251283    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlmhl\" (UniqueName: \"kubernetes.io/projected/49d7d747-4f22-4224-a5f4-e7995330a6ab-kube-api-access-nlmhl\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.251424 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.251390    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49d7d747-4f22-4224-a5f4-e7995330a6ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.251467 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.251428    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/49d7d747-4f22-4224-a5f4-e7995330a6ab-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.352310 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.352256    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlmhl\" (UniqueName: \"kubernetes.io/projected/49d7d747-4f22-4224-a5f4-e7995330a6ab-kube-api-access-nlmhl\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.352418 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.352303    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49d7d747-4f22-4224-a5f4-e7995330a6ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.352418 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.352339    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/49d7d747-4f22-4224-a5f4-e7995330a6ab-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.352488 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.352434    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49d7d747-4f22-4224-a5f4-e7995330a6ab-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.353003 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.352975    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49d7d747-4f22-4224-a5f4-e7995330a6ab-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.354717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.354692    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49d7d747-4f22-4224-a5f4-e7995330a6ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.354806 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.354770    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/49d7d747-4f22-4224-a5f4-e7995330a6ab-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.360892 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.360873    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlmhl\" (UniqueName: \"kubernetes.io/projected/49d7d747-4f22-4224-a5f4-e7995330a6ab-kube-api-access-nlmhl\") pod \"prometheus-operator-7779bbdd78-vtpnw\" (UID: \"49d7d747-4f22-4224-a5f4-e7995330a6ab\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.538961 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.538929    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"
May 27 02:02:04.663018 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:04.662993    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw"]
May 27 02:02:04.665163 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:02:04.665135    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d7d747_4f22_4224_a5f4_e7995330a6ab.slice/crio-36ee003d8931f6726edfc6f0471fdcde6f4dbb24077a3b70c2eef719c3107a08 WatchSource:0}: Error finding container 36ee003d8931f6726edfc6f0471fdcde6f4dbb24077a3b70c2eef719c3107a08: Status 404 returned error can't find the container with id 36ee003d8931f6726edfc6f0471fdcde6f4dbb24077a3b70c2eef719c3107a08
May 27 02:02:05.065118 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:05.065085    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw" event={"ID":"49d7d747-4f22-4224-a5f4-e7995330a6ab","Type":"ContainerStarted","Data":"36ee003d8931f6726edfc6f0471fdcde6f4dbb24077a3b70c2eef719c3107a08"}
May 27 02:02:06.069625 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:06.069594    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw" event={"ID":"49d7d747-4f22-4224-a5f4-e7995330a6ab","Type":"ContainerStarted","Data":"3bec8fe4f274b00f7fa0201e9cda283dfd0f8ac8676c983de7b93771f006bf8a"}
May 27 02:02:06.069999 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:06.069634    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw" event={"ID":"49d7d747-4f22-4224-a5f4-e7995330a6ab","Type":"ContainerStarted","Data":"4e652de51ea1d122e4355c13cae18001233b20a3d60e727aa483eec86553c8b0"}
May 27 02:02:06.087729 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:06.087675    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vtpnw" podStartSLOduration=0.812424968 podStartE2EDuration="2.087656947s" podCreationTimestamp="2026-05-27 02:02:04 +0000 UTC" firstStartedPulling="2026-05-27 02:02:04.667032235 +0000 UTC m=+189.751370495" lastFinishedPulling="2026-05-27 02:02:05.942264201 +0000 UTC m=+191.026602474" observedRunningTime="2026-05-27 02:02:06.08629703 +0000 UTC m=+191.170635322" watchObservedRunningTime="2026-05-27 02:02:06.087656947 +0000 UTC m=+191.171995231"
May 27 02:02:07.672676 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.672634    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9pkl8"]
May 27 02:02:07.675861 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.675842    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.678869 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.678846    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 02:02:07.679323 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.679308    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 02:02:07.679434 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.679324    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wpglj\""
May 27 02:02:07.679434 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.679400    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 02:02:07.776066 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776045    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-root\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.776183 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776100    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.776183 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776131    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-tls\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.776285 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776194    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.776330 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776312    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-textfile\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.776399 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776340    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-metrics-client-ca\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.776399 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776384    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-wtmp\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.776483 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776410    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chctc\" (UniqueName: \"kubernetes.io/projected/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-kube-api-access-chctc\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.776483 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.776438    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-sys\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.876941 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.876913    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chctc\" (UniqueName: \"kubernetes.io/projected/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-kube-api-access-chctc\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877040 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.876967    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-sys\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877040 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877010    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-root\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877125 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877051    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877125 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877077    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-tls\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877125 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877108    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877125 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877111    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-root\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877297 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877117    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-sys\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877297 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877230    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-textfile\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877297 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877256    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-metrics-client-ca\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877297 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877275    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-wtmp\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877533 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877435    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-wtmp\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877603 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877583    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-textfile\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.877820 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.877794    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.878166 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.878144    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-metrics-client-ca\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.879572 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.879551    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-tls\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.879572 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.879568    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.888024 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.888003    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chctc\" (UniqueName: \"kubernetes.io/projected/e8f1ff60-1fbd-4ae2-86be-679d0bb146cc-kube-api-access-chctc\") pod \"node-exporter-9pkl8\" (UID: \"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc\") " pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.986181 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:07.986131    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9pkl8"
May 27 02:02:07.995204 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:02:07.995177    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f1ff60_1fbd_4ae2_86be_679d0bb146cc.slice/crio-d114862615a8f00708f82f46e9fb2d744b43c9ecffabbbadc59703e4933ceef0 WatchSource:0}: Error finding container d114862615a8f00708f82f46e9fb2d744b43c9ecffabbbadc59703e4933ceef0: Status 404 returned error can't find the container with id d114862615a8f00708f82f46e9fb2d744b43c9ecffabbbadc59703e4933ceef0
May 27 02:02:08.075388 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.075342    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9pkl8" event={"ID":"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc","Type":"ContainerStarted","Data":"d114862615a8f00708f82f46e9fb2d744b43c9ecffabbbadc59703e4933ceef0"}
May 27 02:02:08.718279 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.718242    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:02:08.722401 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.722379    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.730866 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.730648    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 27 02:02:08.730866 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.730691    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 27 02:02:08.730866 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.730864    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 27 02:02:08.731070 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.730921    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 27 02:02:08.731139 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.731107    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 27 02:02:08.731502 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.731300    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 27 02:02:08.732886 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.732744    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 27 02:02:08.732886 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.732781    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 27 02:02:08.732886 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.732797    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 27 02:02:08.733608 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.733585    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fkxl4\""
May 27 02:02:08.751921 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.751898    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:02:08.784828 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.784799    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.784983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.784839    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.784983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.784861    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.784983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.784944    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785122 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.784986    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-web-config\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785122 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.785016    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785122 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.785042    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pft2b\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-kube-api-access-pft2b\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785122 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.785093    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785278 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.785184    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785278 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.785228    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-out\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785371 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.785277    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785371 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.785306    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.785473 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.785385    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886077 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886052    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886161 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886123    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886161 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886156    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886260 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886183    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886260 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886223    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886260 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886247    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-web-config\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886418 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886271    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886418 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886295    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pft2b\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-kube-api-access-pft2b\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886418 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886318    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886418 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886367    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886418 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886397    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-out\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886655 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886434    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886655 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886458    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.886655 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.886561    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.887454 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.887158    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.887454 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:02:08.887274    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle podName:f6a07d6e-33b2-4007-bc80-4a0c47257ef1 nodeName:}" failed. No retries permitted until 2026-05-27 02:02:09.387251877 +0000 UTC m=+194.471590152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1") : configmap references non-existent config key: ca-bundle.crt
May 27 02:02:08.890850 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.890161    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.890850 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.890167    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.890850 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.890725    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-out\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.891114 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.890853    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.891847 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.891824    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.891967 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.891902    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.892035 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.891965    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.892267 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.892248    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.892382 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.892342    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-web-config\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:08.910855 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:08.910835    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pft2b\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-kube-api-access-pft2b\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:09.078943 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.078910    2546 generic.go:358] "Generic (PLEG): container finished" podID="e8f1ff60-1fbd-4ae2-86be-679d0bb146cc" containerID="cd9795b07cc9b3b5503f7aa664f4e50694a16ae13df541d3cd913945579eaa37" exitCode=0
May 27 02:02:09.079044 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.078959    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9pkl8" event={"ID":"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc","Type":"ContainerDied","Data":"cd9795b07cc9b3b5503f7aa664f4e50694a16ae13df541d3cd913945579eaa37"}
May 27 02:02:09.391812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.391774    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:09.392520 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.392501    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:09.634745 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.634713    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 02:02:09.710519 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.710494    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6784c76598-m28z5"]
May 27 02:02:09.715285 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.715260    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.722161 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.722112    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 27 02:02:09.722161 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.722127    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 27 02:02:09.722658 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.722126    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bt9sn0e0mchdt\""
May 27 02:02:09.722658 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.722126    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vtcqq\""
May 27 02:02:09.723146 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.723126    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 27 02:02:09.723475 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.723424    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 27 02:02:09.723475 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.723427    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 27 02:02:09.728991 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.728969    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6784c76598-m28z5"]
May 27 02:02:09.794330 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.794300    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-tls\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.794487 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.794341    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md544\" (UniqueName: \"kubernetes.io/projected/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-kube-api-access-md544\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.794487 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.794428    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.794487 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.794453    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.794487 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.794477    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-metrics-client-ca\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.794621 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.794546    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.794621 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.794582    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.794621 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.794616    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-grpc-tls\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.837030 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.836938    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:02:09.840494 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:02:09.840468    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a07d6e_33b2_4007_bc80_4a0c47257ef1.slice/crio-f03e487d8a90e5d508f844161e80f88c59bc35ee800f8a7da0d9f82574c5488e WatchSource:0}: Error finding container f03e487d8a90e5d508f844161e80f88c59bc35ee800f8a7da0d9f82574c5488e: Status 404 returned error can't find the container with id f03e487d8a90e5d508f844161e80f88c59bc35ee800f8a7da0d9f82574c5488e
May 27 02:02:09.895221 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.895166    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-tls\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.895221 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.895209    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-md544\" (UniqueName: \"kubernetes.io/projected/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-kube-api-access-md544\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.895334 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.895301    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.895334 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.895329    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.895457 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.895393    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-metrics-client-ca\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.896496 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.895837    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.896496 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.895899    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.896496 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.895941    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-grpc-tls\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.896496 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.896450    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-metrics-client-ca\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.898402 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.898379    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.898500 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.898416    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.899042 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.899017    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-tls\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.899241 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.899201    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-grpc-tls\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.899615 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.899593    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.900254 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.900232    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:09.904636 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:09.904618    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md544\" (UniqueName: \"kubernetes.io/projected/9e09bd4f-5764-4cdb-9892-b5a3c4c404b6-kube-api-access-md544\") pod \"thanos-querier-6784c76598-m28z5\" (UID: \"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6\") " pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:10.026942 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:10.026919    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:10.085008 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:10.084976    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9pkl8" event={"ID":"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc","Type":"ContainerStarted","Data":"2c0696ea5238bd193e570134194d9f641849ea9a095c81d9d57805e3c2c1db01"}
May 27 02:02:10.085161 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:10.085018    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9pkl8" event={"ID":"e8f1ff60-1fbd-4ae2-86be-679d0bb146cc","Type":"ContainerStarted","Data":"5bc0fd4e921fb10c428e3b3ec07d75beff53b424d5535037b1562f7c73a7996f"}
May 27 02:02:10.086159 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:10.086130    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerStarted","Data":"f03e487d8a90e5d508f844161e80f88c59bc35ee800f8a7da0d9f82574c5488e"}
May 27 02:02:10.107282 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:10.107239    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9pkl8" podStartSLOduration=2.218253985 podStartE2EDuration="3.107226171s" podCreationTimestamp="2026-05-27 02:02:07 +0000 UTC" firstStartedPulling="2026-05-27 02:02:07.997275826 +0000 UTC m=+193.081614098" lastFinishedPulling="2026-05-27 02:02:08.886248024 +0000 UTC m=+193.970586284" observedRunningTime="2026-05-27 02:02:10.10665633 +0000 UTC m=+195.190994614" watchObservedRunningTime="2026-05-27 02:02:10.107226171 +0000 UTC m=+195.191564452"
May 27 02:02:10.154797 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:10.154740    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6784c76598-m28z5"]
May 27 02:02:10.157790 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:02:10.157762    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e09bd4f_5764_4cdb_9892_b5a3c4c404b6.slice/crio-e35d5404587e50bddbe7c6197b0719ba405eff733cec87d40acefce0c7e927f7 WatchSource:0}: Error finding container e35d5404587e50bddbe7c6197b0719ba405eff733cec87d40acefce0c7e927f7: Status 404 returned error can't find the container with id e35d5404587e50bddbe7c6197b0719ba405eff733cec87d40acefce0c7e927f7
May 27 02:02:11.091211 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:11.091171    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerStarted","Data":"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3"}
May 27 02:02:11.092600 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:11.092560    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5" event={"ID":"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6","Type":"ContainerStarted","Data":"e35d5404587e50bddbe7c6197b0719ba405eff733cec87d40acefce0c7e927f7"}
May 27 02:02:12.097263 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:12.097189    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5" event={"ID":"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6","Type":"ContainerStarted","Data":"0e7977df73609a1a9afbc8d705675db2fe3ab87d8fe77c86e9acf5d259112f9a"}
May 27 02:02:12.097263 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:12.097236    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5" event={"ID":"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6","Type":"ContainerStarted","Data":"bea9580279b2887ae0206a8be330f4a45ccceeb6312ab3655ef74f495cdca720"}
May 27 02:02:12.097263 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:12.097255    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5" event={"ID":"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6","Type":"ContainerStarted","Data":"ebbc32c7133ece713e787a5914b904131008441211c3a6cef0849b1bde84d672"}
May 27 02:02:12.098614 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:12.098587    2546 generic.go:358] "Generic (PLEG): container finished" podID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerID="3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3" exitCode=0
May 27 02:02:12.098730 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:12.098623    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerDied","Data":"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3"}
May 27 02:02:13.102929 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:13.102903    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5" event={"ID":"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6","Type":"ContainerStarted","Data":"e1742986e2db6d2b2161bdce0e0d2164e9113392b2e18bf0c5d9897b0e6b173e"}
May 27 02:02:14.012779 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.012698    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:02:14.017506 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.017480    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.020526 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.020494    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 27 02:02:14.020526 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.020521    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 27 02:02:14.021853 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.021829    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 27 02:02:14.021962 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.021829    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 27 02:02:14.021962 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.021837    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 27 02:02:14.022065 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.021837    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 27 02:02:14.022557 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.022531    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 27 02:02:14.024151 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.022650    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 27 02:02:14.024151 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.022777    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-j5j95pg6qqo3\""
May 27 02:02:14.024151 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.022993    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 27 02:02:14.024151 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.023804    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 27 02:02:14.024151 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.024027    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fwhbn\""
May 27 02:02:14.024826 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.024778    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 27 02:02:14.025668 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.025624    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 27 02:02:14.028405 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.028382    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 27 02:02:14.040281 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.040257    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:02:14.108621 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.108585    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerStarted","Data":"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118"}
May 27 02:02:14.108621 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.108621    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerStarted","Data":"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4"}
May 27 02:02:14.109070 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.108637    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerStarted","Data":"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09"}
May 27 02:02:14.109070 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.108651    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerStarted","Data":"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35"}
May 27 02:02:14.109070 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.108664    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerStarted","Data":"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5"}
May 27 02:02:14.109070 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.108675    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerStarted","Data":"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48"}
May 27 02:02:14.111277 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.111248    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5" event={"ID":"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6","Type":"ContainerStarted","Data":"ade9fe3a0079eaac46049daca50eb851f169268f822fbea46e8c9764b89c2489"}
May 27 02:02:14.111420 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.111283    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5" event={"ID":"9e09bd4f-5764-4cdb-9892-b5a3c4c404b6","Type":"ContainerStarted","Data":"104aee3c278e783d7b54e1f284e6d075706cdee2de8048f4512baa8ccb93ceb0"}
May 27 02:02:14.111515 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.111500    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:14.134149 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134120    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-config\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134245 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134158    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134245 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134218    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134396 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134314    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134396 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134374    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134509 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134432    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134509 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134474    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134625 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134530    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-web-config\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134682 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134654    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134736 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134686    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134736 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134723    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-config-out\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134806 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134753    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134861 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134845    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpgnq\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-kube-api-access-dpgnq\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134895 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134884    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134949 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134935    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.134984 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134963    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.135020 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134983    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.135020 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.134998    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.143088 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.143040    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.501475878 podStartE2EDuration="6.143026218s" podCreationTimestamp="2026-05-27 02:02:08 +0000 UTC" firstStartedPulling="2026-05-27 02:02:09.842388603 +0000 UTC m=+194.926726865" lastFinishedPulling="2026-05-27 02:02:13.483938931 +0000 UTC m=+198.568277205" observedRunningTime="2026-05-27 02:02:14.141116312 +0000 UTC m=+199.225454594" watchObservedRunningTime="2026-05-27 02:02:14.143026218 +0000 UTC m=+199.227364501"
May 27 02:02:14.166216 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.166173    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5" podStartSLOduration=2.339814048 podStartE2EDuration="5.166155758s" podCreationTimestamp="2026-05-27 02:02:09 +0000 UTC" firstStartedPulling="2026-05-27 02:02:10.159613992 +0000 UTC m=+195.243952255" lastFinishedPulling="2026-05-27 02:02:12.985955704 +0000 UTC m=+198.070293965" observedRunningTime="2026-05-27 02:02:14.165570218 +0000 UTC m=+199.249908501" watchObservedRunningTime="2026-05-27 02:02:14.166155758 +0000 UTC m=+199.250494041"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236316    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236428    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236458    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236488    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236516    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236591    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-config\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236618    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236642    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236684    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.236723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236711    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237366 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236743    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237366 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236768    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237366 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236815    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-web-config\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237366 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236871    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237366 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236899    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237366 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236930    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-config-out\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237366 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.236959    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237366 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.237094    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpgnq\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-kube-api-access-dpgnq\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237956 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.237816    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.237956 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.237844    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.238632 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.238513    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.239779 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.239755    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.240734 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.240518    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.242221 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.240965    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-config\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.242221 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.241727    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.242221 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.242183    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.242773 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.242747    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.242866 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.242813    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-web-config\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.242971 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.242947    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.243068 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.243042    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-config-out\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.243179 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.243160    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.243665 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.243641    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.243759 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.243703    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.244060 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.244040    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.244427 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.244411    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.251680 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.251658    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpgnq\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-kube-api-access-dpgnq\") pod \"prometheus-k8s-0\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.330080 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.330042    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:14.480187 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:14.480166    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:02:14.481865 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:02:14.481837    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d69de8_0239_482e_82d5_a5a5e596d829.slice/crio-b1dcbd87cccc3a4d6302f2209ff4d0c61b6d858864980dac76ebc02d53b3bd75 WatchSource:0}: Error finding container b1dcbd87cccc3a4d6302f2209ff4d0c61b6d858864980dac76ebc02d53b3bd75: Status 404 returned error can't find the container with id b1dcbd87cccc3a4d6302f2209ff4d0c61b6d858864980dac76ebc02d53b3bd75
May 27 02:02:15.115559 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:15.115525    2546 generic.go:358] "Generic (PLEG): container finished" podID="10d69de8-0239-482e-82d5-a5a5e596d829" containerID="095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d" exitCode=0
May 27 02:02:15.115913 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:15.115615    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerDied","Data":"095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d"}
May 27 02:02:15.115913 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:15.115661    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerStarted","Data":"b1dcbd87cccc3a4d6302f2209ff4d0c61b6d858864980dac76ebc02d53b3bd75"}
May 27 02:02:15.964189 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:15.964153    2546 patch_prober.go:28] interesting pod/image-registry-795d4b9689-7gb52 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 02:02:15.964337 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:15.964208    2546 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-795d4b9689-7gb52" podUID="3d6bdb31-c6e5-40c9-9275-b85e540df3ca" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 02:02:18.045883 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.045822    2546 patch_prober.go:28] interesting pod/image-registry-795d4b9689-7gb52 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 02:02:18.045883 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.045865    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-795d4b9689-7gb52" podUID="3d6bdb31-c6e5-40c9-9275-b85e540df3ca" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 02:02:18.127441 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.127414    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerStarted","Data":"1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb"}
May 27 02:02:18.127441 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.127444    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerStarted","Data":"6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63"}
May 27 02:02:18.127601 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.127453    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerStarted","Data":"c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153"}
May 27 02:02:18.127601 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.127461    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerStarted","Data":"2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3"}
May 27 02:02:18.127601 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.127469    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerStarted","Data":"b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561"}
May 27 02:02:18.127601 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.127477    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerStarted","Data":"8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b"}
May 27 02:02:18.180242 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:18.180195    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.762934074 podStartE2EDuration="5.180178985s" podCreationTimestamp="2026-05-27 02:02:13 +0000 UTC" firstStartedPulling="2026-05-27 02:02:15.116755048 +0000 UTC m=+200.201093311" lastFinishedPulling="2026-05-27 02:02:17.53399996 +0000 UTC m=+202.618338222" observedRunningTime="2026-05-27 02:02:18.177587468 +0000 UTC m=+203.261925751" watchObservedRunningTime="2026-05-27 02:02:18.180178985 +0000 UTC m=+203.264517269"
May 27 02:02:19.330849 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:19.330816    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:02:20.121948 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:20.121920    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6784c76598-m28z5"
May 27 02:02:25.962931 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:25.962899    2546 patch_prober.go:28] interesting pod/image-registry-795d4b9689-7gb52 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 02:02:25.963416 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:25.962945    2546 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-795d4b9689-7gb52" podUID="3d6bdb31-c6e5-40c9-9275-b85e540df3ca" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 02:02:28.045903 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:28.045877    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-795d4b9689-7gb52"
May 27 02:02:35.179815 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:35.179778    2546 generic.go:358] "Generic (PLEG): container finished" podID="631d8adb-7415-42da-9494-5a1d17471847" containerID="b8678657468d69e1821f245f47bf28ec8cfce41d3a8da6bd030e79baefb93713" exitCode=0
May 27 02:02:35.180300 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:35.179856    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc" event={"ID":"631d8adb-7415-42da-9494-5a1d17471847","Type":"ContainerDied","Data":"b8678657468d69e1821f245f47bf28ec8cfce41d3a8da6bd030e79baefb93713"}
May 27 02:02:35.180300 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:35.180251    2546 scope.go:117] "RemoveContainer" containerID="b8678657468d69e1821f245f47bf28ec8cfce41d3a8da6bd030e79baefb93713"
May 27 02:02:36.183795 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:36.183765    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wpmsc" event={"ID":"631d8adb-7415-42da-9494-5a1d17471847","Type":"ContainerStarted","Data":"8579fc826ebfc4d4bb96f06b88abdf35ada5849732934bb7e818165d980f3cd8"}
May 27 02:02:55.242924 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:55.242887    2546 generic.go:358] "Generic (PLEG): container finished" podID="f5050292-e23b-4e71-86ba-9f651f950347" containerID="9143f9593fe8b1beb6f29acace5210aa0d2efcb9ebc7fcf6139aa056b7836ddb" exitCode=0
May 27 02:02:55.243444 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:55.242970    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg" event={"ID":"f5050292-e23b-4e71-86ba-9f651f950347","Type":"ContainerDied","Data":"9143f9593fe8b1beb6f29acace5210aa0d2efcb9ebc7fcf6139aa056b7836ddb"}
May 27 02:02:55.243444 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:55.243423    2546 scope.go:117] "RemoveContainer" containerID="9143f9593fe8b1beb6f29acace5210aa0d2efcb9ebc7fcf6139aa056b7836ddb"
May 27 02:02:56.250776 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:02:56.250728    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-v8spg" event={"ID":"f5050292-e23b-4e71-86ba-9f651f950347","Type":"ContainerStarted","Data":"e9490166c4adb856ba468136a868d0c9bea1feb9dd7e4d9aea7495becd666fa5"}
May 27 02:03:05.596600 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:05.596569    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxkhd_ebdb4199-7ea7-42c4-8c69-ba63d7049d8e/dns-node-resolver/0.log"
May 27 02:03:07.378007 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:07.377972    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 02:03:07.380910 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:07.380876    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ae416e9-a5f3-4e13-b60f-f60797baf9ae-metrics-certs\") pod \"network-metrics-daemon-zdfpv\" (UID: \"6ae416e9-a5f3-4e13-b60f-f60797baf9ae\") " pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 02:03:07.647769 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:07.647708    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9d6nl\""
May 27 02:03:07.655294 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:07.655272    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdfpv"
May 27 02:03:07.786286 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:07.786242    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zdfpv"]
May 27 02:03:07.789051 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:03:07.789023    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae416e9_a5f3_4e13_b60f_f60797baf9ae.slice/crio-654f2b0c4aa139443781a83c6f40e39efbfd4c8e84aaa7a6fd22e4cdb089d6de WatchSource:0}: Error finding container 654f2b0c4aa139443781a83c6f40e39efbfd4c8e84aaa7a6fd22e4cdb089d6de: Status 404 returned error can't find the container with id 654f2b0c4aa139443781a83c6f40e39efbfd4c8e84aaa7a6fd22e4cdb089d6de
May 27 02:03:08.291139 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:08.291106    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdfpv" event={"ID":"6ae416e9-a5f3-4e13-b60f-f60797baf9ae","Type":"ContainerStarted","Data":"654f2b0c4aa139443781a83c6f40e39efbfd4c8e84aaa7a6fd22e4cdb089d6de"}
May 27 02:03:09.297479 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:09.297446    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdfpv" event={"ID":"6ae416e9-a5f3-4e13-b60f-f60797baf9ae","Type":"ContainerStarted","Data":"7c3e11bd695202265ff51d6f0209c7016f254c7b65288e3db36764a8fd0fb155"}
May 27 02:03:09.297479 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:09.297481    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdfpv" event={"ID":"6ae416e9-a5f3-4e13-b60f-f60797baf9ae","Type":"ContainerStarted","Data":"33121a02e092e0edd9175259660163ffb1545af75ce0a63640837ef4d3de3b07"}
May 27 02:03:09.339020 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:09.338938    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zdfpv" podStartSLOduration=253.057085238 podStartE2EDuration="4m14.338923315s" podCreationTimestamp="2026-05-27 01:58:55 +0000 UTC" firstStartedPulling="2026-05-27 02:03:07.791237361 +0000 UTC m=+252.875575622" lastFinishedPulling="2026-05-27 02:03:09.073075439 +0000 UTC m=+254.157413699" observedRunningTime="2026-05-27 02:03:09.336769134 +0000 UTC m=+254.421107417" watchObservedRunningTime="2026-05-27 02:03:09.338923315 +0000 UTC m=+254.423261596"
May 27 02:03:14.330478 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:14.330386    2546 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:14.347989 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:14.347961    2546 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:15.332803 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:15.332776    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:28.006793 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.006752    2546 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:03:28.007414 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.007336    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="alertmanager" containerID="cri-o://0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48" gracePeriod=120
May 27 02:03:28.007537 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.007417    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy-metric" containerID="cri-o://cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4" gracePeriod=120
May 27 02:03:28.007537 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.007465    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="prom-label-proxy" containerID="cri-o://89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118" gracePeriod=120
May 27 02:03:28.007537 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.007423    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy-web" containerID="cri-o://9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35" gracePeriod=120
May 27 02:03:28.007537 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.007485    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy" containerID="cri-o://56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09" gracePeriod=120
May 27 02:03:28.007723 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.007484    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="config-reloader" containerID="cri-o://7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5" gracePeriod=120
May 27 02:03:28.362132 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.362096    2546 generic.go:358] "Generic (PLEG): container finished" podID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerID="89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118" exitCode=0
May 27 02:03:28.362132 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.362122    2546 generic.go:358] "Generic (PLEG): container finished" podID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerID="56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09" exitCode=0
May 27 02:03:28.362132 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.362128    2546 generic.go:358] "Generic (PLEG): container finished" podID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerID="7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5" exitCode=0
May 27 02:03:28.362132 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.362134    2546 generic.go:358] "Generic (PLEG): container finished" podID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerID="0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48" exitCode=0
May 27 02:03:28.362387 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.362169    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerDied","Data":"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118"}
May 27 02:03:28.362387 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.362210    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerDied","Data":"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09"}
May 27 02:03:28.362387 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.362221    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerDied","Data":"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5"}
May 27 02:03:28.362387 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:28.362230    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerDied","Data":"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48"}
May 27 02:03:29.248955 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.248935    2546 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.366907 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.366831    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-web\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.366907 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.366865    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-web-config\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.366907 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.366899    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-main-db\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.366917    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-main-tls\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.366935    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-tls-assets\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367021    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367047    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-metrics-client-ca\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367084    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-cluster-tls-config\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367116    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-volume\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367163 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367163    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-out\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367534 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367205    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pft2b\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-kube-api-access-pft2b\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367534 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367241    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.367534 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367273    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy\") pod \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\" (UID: \"f6a07d6e-33b2-4007-bc80-4a0c47257ef1\") "
May 27 02:03:29.368616 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.367237    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:03:29.369547 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.369311    2546 generic.go:358] "Generic (PLEG): container finished" podID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerID="cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4" exitCode=0
May 27 02:03:29.369547 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.368580    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:29.369547 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.369489    2546 generic.go:358] "Generic (PLEG): container finished" podID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerID="9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35" exitCode=0
May 27 02:03:29.369547 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.369020    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:29.369547 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.369517    2546 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.369869 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.369338    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerDied","Data":"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4"}
May 27 02:03:29.369869 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.369623    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerDied","Data":"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35"}
May 27 02:03:29.369869 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.369640    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6a07d6e-33b2-4007-bc80-4a0c47257ef1","Type":"ContainerDied","Data":"f03e487d8a90e5d508f844161e80f88c59bc35ee800f8a7da0d9f82574c5488e"}
May 27 02:03:29.369869 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.369659    2546 scope.go:117] "RemoveContainer" containerID="89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118"
May 27 02:03:29.370610 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.370468    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:29.370705 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.370666    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:03:29.370972 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.370918    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:29.371104 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.371078    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:29.371178 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.371161    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-volume" (OuterVolumeSpecName: "config-volume") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:29.371521 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.371458    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-kube-api-access-pft2b" (OuterVolumeSpecName: "kube-api-access-pft2b") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "kube-api-access-pft2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:03:29.371770 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.371742    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:29.372612 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.372583    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-out" (OuterVolumeSpecName: "config-out") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:03:29.376085 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.376062    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:29.381955 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.381933    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-web-config" (OuterVolumeSpecName: "web-config") pod "f6a07d6e-33b2-4007-bc80-4a0c47257ef1" (UID: "f6a07d6e-33b2-4007-bc80-4a0c47257ef1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:29.384998 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.384973    2546 scope.go:117] "RemoveContainer" containerID="cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4"
May 27 02:03:29.391250 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.391233    2546 scope.go:117] "RemoveContainer" containerID="56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09"
May 27 02:03:29.397532 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.397517    2546 scope.go:117] "RemoveContainer" containerID="9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35"
May 27 02:03:29.403432 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.403416    2546 scope.go:117] "RemoveContainer" containerID="7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5"
May 27 02:03:29.409619 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.409606    2546 scope.go:117] "RemoveContainer" containerID="0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48"
May 27 02:03:29.416126 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.416109    2546 scope.go:117] "RemoveContainer" containerID="3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3"
May 27 02:03:29.422200 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.422183    2546 scope.go:117] "RemoveContainer" containerID="89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118"
May 27 02:03:29.422498 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:29.422467    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118\": container with ID starting with 89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118 not found: ID does not exist" containerID="89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118"
May 27 02:03:29.422553 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.422508    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118"} err="failed to get container status \"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118\": rpc error: code = NotFound desc = could not find container \"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118\": container with ID starting with 89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118 not found: ID does not exist"
May 27 02:03:29.422553 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.422539    2546 scope.go:117] "RemoveContainer" containerID="cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4"
May 27 02:03:29.422786 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:29.422767    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4\": container with ID starting with cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4 not found: ID does not exist" containerID="cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4"
May 27 02:03:29.422833 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.422792    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4"} err="failed to get container status \"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4\": rpc error: code = NotFound desc = could not find container \"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4\": container with ID starting with cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4 not found: ID does not exist"
May 27 02:03:29.422833 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.422808    2546 scope.go:117] "RemoveContainer" containerID="56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09"
May 27 02:03:29.423008 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:29.422991    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09\": container with ID starting with 56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09 not found: ID does not exist" containerID="56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09"
May 27 02:03:29.423066 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423017    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09"} err="failed to get container status \"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09\": rpc error: code = NotFound desc = could not find container \"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09\": container with ID starting with 56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09 not found: ID does not exist"
May 27 02:03:29.423066 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423038    2546 scope.go:117] "RemoveContainer" containerID="9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35"
May 27 02:03:29.423268 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:29.423247    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35\": container with ID starting with 9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35 not found: ID does not exist" containerID="9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35"
May 27 02:03:29.423308 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423275    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35"} err="failed to get container status \"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35\": rpc error: code = NotFound desc = could not find container \"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35\": container with ID starting with 9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35 not found: ID does not exist"
May 27 02:03:29.423308 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423287    2546 scope.go:117] "RemoveContainer" containerID="7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5"
May 27 02:03:29.423534 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:29.423517    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5\": container with ID starting with 7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5 not found: ID does not exist" containerID="7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5"
May 27 02:03:29.423601 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423538    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5"} err="failed to get container status \"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5\": rpc error: code = NotFound desc = could not find container \"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5\": container with ID starting with 7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5 not found: ID does not exist"
May 27 02:03:29.423601 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423552    2546 scope.go:117] "RemoveContainer" containerID="0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48"
May 27 02:03:29.423751 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:29.423738    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48\": container with ID starting with 0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48 not found: ID does not exist" containerID="0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48"
May 27 02:03:29.423793 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423754    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48"} err="failed to get container status \"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48\": rpc error: code = NotFound desc = could not find container \"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48\": container with ID starting with 0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48 not found: ID does not exist"
May 27 02:03:29.423793 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423767    2546 scope.go:117] "RemoveContainer" containerID="3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3"
May 27 02:03:29.423947 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:29.423933    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3\": container with ID starting with 3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3 not found: ID does not exist" containerID="3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3"
May 27 02:03:29.423983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423949    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3"} err="failed to get container status \"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3\": rpc error: code = NotFound desc = could not find container \"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3\": container with ID starting with 3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3 not found: ID does not exist"
May 27 02:03:29.423983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.423962    2546 scope.go:117] "RemoveContainer" containerID="89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118"
May 27 02:03:29.424136 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424108    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118"} err="failed to get container status \"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118\": rpc error: code = NotFound desc = could not find container \"89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118\": container with ID starting with 89a9225568f442f53ed70b219a01c27882fb33425ab9085045d28e74188fc118 not found: ID does not exist"
May 27 02:03:29.424136 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424133    2546 scope.go:117] "RemoveContainer" containerID="cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4"
May 27 02:03:29.424396 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424326    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4"} err="failed to get container status \"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4\": rpc error: code = NotFound desc = could not find container \"cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4\": container with ID starting with cc07ba99700102be097a66dcf47bc86fcee34f413593cabae24ed2b1372691e4 not found: ID does not exist"
May 27 02:03:29.424396 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424370    2546 scope.go:117] "RemoveContainer" containerID="56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09"
May 27 02:03:29.424588 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424567    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09"} err="failed to get container status \"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09\": rpc error: code = NotFound desc = could not find container \"56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09\": container with ID starting with 56b37a65fb38e860adf14e9465c950444174cf95038c647eba079b7907151b09 not found: ID does not exist"
May 27 02:03:29.424659 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424590    2546 scope.go:117] "RemoveContainer" containerID="9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35"
May 27 02:03:29.424782 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424765    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35"} err="failed to get container status \"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35\": rpc error: code = NotFound desc = could not find container \"9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35\": container with ID starting with 9fa7bed4f81e066531918de7f8c76da5ea219f87c3497b91a087fe03cf049d35 not found: ID does not exist"
May 27 02:03:29.424845 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424783    2546 scope.go:117] "RemoveContainer" containerID="7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5"
May 27 02:03:29.425011 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.424994    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5"} err="failed to get container status \"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5\": rpc error: code = NotFound desc = could not find container \"7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5\": container with ID starting with 7023f83be50bbf9e679187e776888359a4fcaceb931d1d42203886da00160ca5 not found: ID does not exist"
May 27 02:03:29.425053 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.425020    2546 scope.go:117] "RemoveContainer" containerID="0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48"
May 27 02:03:29.425214 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.425196    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48"} err="failed to get container status \"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48\": rpc error: code = NotFound desc = could not find container \"0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48\": container with ID starting with 0168f8813587323a538050a3dbb580cecfda7843de86bd6740fe5dabbaaefe48 not found: ID does not exist"
May 27 02:03:29.425279 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.425215    2546 scope.go:117] "RemoveContainer" containerID="3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3"
May 27 02:03:29.425460 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.425443    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3"} err="failed to get container status \"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3\": rpc error: code = NotFound desc = could not find container \"3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3\": container with ID starting with 3cba4cfc67096e02ca2ee4360ad9498ebc04b93b8627a827f152c096d44364c3 not found: ID does not exist"
May 27 02:03:29.468922 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.468898    2546 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-main-db\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469014 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.468928    2546 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-main-tls\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469014 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.468945    2546 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-tls-assets\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469014 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.468960    2546 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469014 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.468975    2546 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-metrics-client-ca\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469014 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.468988    2546 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-cluster-tls-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469014 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.469000    2546 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-volume\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469245 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.469022    2546 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-config-out\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469245 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.469037    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pft2b\" (UniqueName: \"kubernetes.io/projected/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-kube-api-access-pft2b\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469245 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.469047    2546 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469245 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.469056    2546 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469245 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.469065    2546 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.469245 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.469075    2546 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6a07d6e-33b2-4007-bc80-4a0c47257ef1-web-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:29.692625 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.692548    2546 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:03:29.697583 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.697557    2546 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:03:29.751146 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751123    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:03:29.751436 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751423    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="alertmanager"
May 27 02:03:29.751486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751438    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="alertmanager"
May 27 02:03:29.751486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751449    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="config-reloader"
May 27 02:03:29.751486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751455    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="config-reloader"
May 27 02:03:29.751486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751462    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="prom-label-proxy"
May 27 02:03:29.751486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751468    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="prom-label-proxy"
May 27 02:03:29.751486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751477    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="init-config-reloader"
May 27 02:03:29.751486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751482    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="init-config-reloader"
May 27 02:03:29.751486 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751488    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy-web"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751493    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy-web"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751498    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy-metric"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751503    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy-metric"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751511    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751516    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751563    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751569    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="config-reloader"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751574    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy-web"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751581    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="alertmanager"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751588    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="kube-rbac-proxy-metric"
May 27 02:03:29.751717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.751595    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" containerName="prom-label-proxy"
May 27 02:03:29.758466 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.758446    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.764786 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.764765    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 27 02:03:29.764910 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.764891    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 27 02:03:29.764958 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.764946    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 27 02:03:29.765068 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.765052    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 27 02:03:29.765427 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.765375    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 27 02:03:29.765489 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.765411    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 27 02:03:29.765489 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.765455    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 27 02:03:29.766018 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.766005    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fkxl4\""
May 27 02:03:29.766212 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.766198    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 27 02:03:29.774772 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.774673    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 27 02:03:29.784739 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.784713    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:03:29.872020 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.871993    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872159 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872027    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-web-config\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872159 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872047    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50cc595e-910c-4093-90c7-965b7f92c93c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872159 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872064    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872282 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872165    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-config-volume\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872282 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872194    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872282 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872210    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872282 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872269    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872440 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872302    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50cc595e-910c-4093-90c7-965b7f92c93c-config-out\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872440 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872334    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmjx9\" (UniqueName: \"kubernetes.io/projected/50cc595e-910c-4093-90c7-965b7f92c93c-kube-api-access-zmjx9\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872440 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872395    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/50cc595e-910c-4093-90c7-965b7f92c93c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872440 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872415    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50cc595e-910c-4093-90c7-965b7f92c93c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.872440 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.872436    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50cc595e-910c-4093-90c7-965b7f92c93c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973611 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973549    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973611 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973598    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50cc595e-910c-4093-90c7-965b7f92c93c-config-out\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973759 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973632    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmjx9\" (UniqueName: \"kubernetes.io/projected/50cc595e-910c-4093-90c7-965b7f92c93c-kube-api-access-zmjx9\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973759 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973658    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/50cc595e-910c-4093-90c7-965b7f92c93c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973759 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973681    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50cc595e-910c-4093-90c7-965b7f92c93c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973759 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973708    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50cc595e-910c-4093-90c7-965b7f92c93c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973759 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973750    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973780    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-web-config\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973802    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50cc595e-910c-4093-90c7-965b7f92c93c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973829    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973892    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-config-volume\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973920    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.973983 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.973948    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.974656 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.974635    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50cc595e-910c-4093-90c7-965b7f92c93c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.974755 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.974731    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/50cc595e-910c-4093-90c7-965b7f92c93c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.974842 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.974816    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50cc595e-910c-4093-90c7-965b7f92c93c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.976802 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.976775    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50cc595e-910c-4093-90c7-965b7f92c93c-config-out\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.977040 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.977015    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-web-config\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.977184 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.977162    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.977251 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.977166    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.977487 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.977459    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.977595 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.977529    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-config-volume\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.977693 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.977668    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50cc595e-910c-4093-90c7-965b7f92c93c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.977817 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.977802    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.978856 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.978839    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/50cc595e-910c-4093-90c7-965b7f92c93c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:29.983944 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:29.983922    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmjx9\" (UniqueName: \"kubernetes.io/projected/50cc595e-910c-4093-90c7-965b7f92c93c-kube-api-access-zmjx9\") pod \"alertmanager-main-0\" (UID: \"50cc595e-910c-4093-90c7-965b7f92c93c\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:30.067637 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:30.067618    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 02:03:30.210066 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:30.210034    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 02:03:30.213410 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:03:30.213382    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cc595e_910c_4093_90c7_965b7f92c93c.slice/crio-789f3c17e64238e882bf28eab6c37b9b8f3eaf00df30066f393305703e0a48cf WatchSource:0}: Error finding container 789f3c17e64238e882bf28eab6c37b9b8f3eaf00df30066f393305703e0a48cf: Status 404 returned error can't find the container with id 789f3c17e64238e882bf28eab6c37b9b8f3eaf00df30066f393305703e0a48cf
May 27 02:03:30.374075 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:30.374050    2546 generic.go:358] "Generic (PLEG): container finished" podID="50cc595e-910c-4093-90c7-965b7f92c93c" containerID="b175f266e9fb6e4f5ad733871a18654955ae2f49cbe27e5e5d530fcdea23d596" exitCode=0
May 27 02:03:30.374425 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:30.374112    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50cc595e-910c-4093-90c7-965b7f92c93c","Type":"ContainerDied","Data":"b175f266e9fb6e4f5ad733871a18654955ae2f49cbe27e5e5d530fcdea23d596"}
May 27 02:03:30.374425 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:30.374145    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50cc595e-910c-4093-90c7-965b7f92c93c","Type":"ContainerStarted","Data":"789f3c17e64238e882bf28eab6c37b9b8f3eaf00df30066f393305703e0a48cf"}
May 27 02:03:31.381474 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:31.381395    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50cc595e-910c-4093-90c7-965b7f92c93c","Type":"ContainerStarted","Data":"003fa456a887eaf215210e9e84e011a9ba93e049a2693554e38247d676b7a1eb"}
May 27 02:03:31.381474 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:31.381441    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50cc595e-910c-4093-90c7-965b7f92c93c","Type":"ContainerStarted","Data":"742c2ab3b8381a7a1f073719cb6a616e2417f27cf4df870233594a25d593d463"}
May 27 02:03:31.381474 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:31.381453    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50cc595e-910c-4093-90c7-965b7f92c93c","Type":"ContainerStarted","Data":"e5ab6cdc63d824a45fdde7a3e2630e622633bd8f647aefc4ff7c1cd2d62a25dd"}
May 27 02:03:31.381474 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:31.381465    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50cc595e-910c-4093-90c7-965b7f92c93c","Type":"ContainerStarted","Data":"d32e3feffdf829014975e8b837028fcdaae6525808299c6797392acaa95c4636"}
May 27 02:03:31.381474 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:31.381473    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50cc595e-910c-4093-90c7-965b7f92c93c","Type":"ContainerStarted","Data":"b80c65c728a9d85ac11b93d4692bd45c4482ff71a88edd832b52446767fa2840"}
May 27 02:03:31.381963 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:31.381481    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50cc595e-910c-4093-90c7-965b7f92c93c","Type":"ContainerStarted","Data":"08fd6e76acc18e9308d7f431add8b138856c2df0bdb2c10388084401f31afaaf"}
May 27 02:03:31.410476 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:31.410433    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.410419045 podStartE2EDuration="2.410419045s" podCreationTimestamp="2026-05-27 02:03:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:03:31.410193734 +0000 UTC m=+276.494532015" watchObservedRunningTime="2026-05-27 02:03:31.410419045 +0000 UTC m=+276.494757326"
May 27 02:03:31.548253 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:31.548223    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a07d6e-33b2-4007-bc80-4a0c47257ef1" path="/var/lib/kubelet/pods/f6a07d6e-33b2-4007-bc80-4a0c47257ef1/volumes"
May 27 02:03:32.350155 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:32.350116    2546 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:03:32.350685 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:32.350656    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="prometheus" containerID="cri-o://8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b" gracePeriod=600
May 27 02:03:32.351172 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:32.351147    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb" gracePeriod=600
May 27 02:03:32.352272 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:32.351630    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy" containerID="cri-o://6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63" gracePeriod=600
May 27 02:03:32.352481 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:32.351658    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy-web" containerID="cri-o://c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153" gracePeriod=600
May 27 02:03:32.352632 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:32.351679    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="thanos-sidecar" containerID="cri-o://2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3" gracePeriod=600
May 27 02:03:32.352632 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:32.351695    2546 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="config-reloader" containerID="cri-o://b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561" gracePeriod=600
May 27 02:03:33.392872 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392836    2546 generic.go:358] "Generic (PLEG): container finished" podID="10d69de8-0239-482e-82d5-a5a5e596d829" containerID="1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb" exitCode=0
May 27 02:03:33.392872 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392865    2546 generic.go:358] "Generic (PLEG): container finished" podID="10d69de8-0239-482e-82d5-a5a5e596d829" containerID="6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63" exitCode=0
May 27 02:03:33.392872 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392871    2546 generic.go:358] "Generic (PLEG): container finished" podID="10d69de8-0239-482e-82d5-a5a5e596d829" containerID="2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3" exitCode=0
May 27 02:03:33.392872 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392878    2546 generic.go:358] "Generic (PLEG): container finished" podID="10d69de8-0239-482e-82d5-a5a5e596d829" containerID="b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561" exitCode=0
May 27 02:03:33.392872 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392883    2546 generic.go:358] "Generic (PLEG): container finished" podID="10d69de8-0239-482e-82d5-a5a5e596d829" containerID="8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b" exitCode=0
May 27 02:03:33.393430 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392914    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerDied","Data":"1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb"}
May 27 02:03:33.393430 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392965    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerDied","Data":"6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63"}
May 27 02:03:33.393430 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392983    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerDied","Data":"2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3"}
May 27 02:03:33.393430 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.392999    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerDied","Data":"b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561"}
May 27 02:03:33.393430 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.393015    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerDied","Data":"8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b"}
May 27 02:03:33.619900 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.619876    2546 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:33.704495 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704427    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-serving-certs-ca-bundle\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704495 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704474    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-grpc-tls\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704696 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704516    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-tls\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704696 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704543    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-metrics-client-ca\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704696 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704572    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-db\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704696 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704599    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-metrics-client-certs\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704696 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704624    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-rulefiles-0\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704696 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704649    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-trusted-ca-bundle\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704708    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-kubelet-serving-ca-bundle\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704735    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-web-config\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704763    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704794    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-config\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704819    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-tls-assets\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704857    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpgnq\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-kube-api-access-dpgnq\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704907    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704897    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704920    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704938    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-kube-rbac-proxy\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.704973 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.704966    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-thanos-prometheus-http-client-file\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.705542 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.705017    2546 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-config-out\") pod \"10d69de8-0239-482e-82d5-a5a5e596d829\" (UID: \"10d69de8-0239-482e-82d5-a5a5e596d829\") "
May 27 02:03:33.705542 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.705145    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:33.705542 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.705370    2546 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-metrics-client-ca\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.705542 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.705392    2546 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.705542 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.705410    2546 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.706681 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.706656    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:03:33.706886 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.706658    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:33.707917 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.707887    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.708084 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.708060    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:33.708283 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.708254    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.709074 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.709022    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.709934 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.709905    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-config-out" (OuterVolumeSpecName: "config-out") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:03:33.710861 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.710826    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.710861 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.710838    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.711012 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.710874    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.711012 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.710986    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-config" (OuterVolumeSpecName: "config") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.711112 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.711051    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-kube-api-access-dpgnq" (OuterVolumeSpecName: "kube-api-access-dpgnq") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "kube-api-access-dpgnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:03:33.711112 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.711064    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.711489 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.711465    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:03:33.722315 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.722291    2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-web-config" (OuterVolumeSpecName: "web-config") pod "10d69de8-0239-482e-82d5-a5a5e596d829" (UID: "10d69de8-0239-482e-82d5-a5a5e596d829"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:33.806422 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806397    2546 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806422 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806420    2546 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-web-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806436    2546 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806449    2546 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806461    2546 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-tls-assets\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806474    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpgnq\" (UniqueName: \"kubernetes.io/projected/10d69de8-0239-482e-82d5-a5a5e596d829-kube-api-access-dpgnq\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806488    2546 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806503    2546 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-kube-rbac-proxy\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806517    2546 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806531    2546 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-config-out\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806546    2546 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-grpc-tls\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806559    2546 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806570 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806572    2546 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-db\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806885 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806586    2546 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d69de8-0239-482e-82d5-a5a5e596d829-secret-metrics-client-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:33.806885 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:33.806600    2546 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d69de8-0239-482e-82d5-a5a5e596d829-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
May 27 02:03:34.403007 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.402977    2546 generic.go:358] "Generic (PLEG): container finished" podID="10d69de8-0239-482e-82d5-a5a5e596d829" containerID="c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153" exitCode=0
May 27 02:03:34.403301 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.403061    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerDied","Data":"c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153"}
May 27 02:03:34.403301 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.403106    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d69de8-0239-482e-82d5-a5a5e596d829","Type":"ContainerDied","Data":"b1dcbd87cccc3a4d6302f2209ff4d0c61b6d858864980dac76ebc02d53b3bd75"}
May 27 02:03:34.403301 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.403119    2546 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.403301 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.403126    2546 scope.go:117] "RemoveContainer" containerID="1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb"
May 27 02:03:34.411518 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.411495    2546 scope.go:117] "RemoveContainer" containerID="6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63"
May 27 02:03:34.419240 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.419219    2546 scope.go:117] "RemoveContainer" containerID="c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153"
May 27 02:03:34.426466 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.426439    2546 scope.go:117] "RemoveContainer" containerID="2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3"
May 27 02:03:34.427327 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.427301    2546 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:03:34.433314 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.433288    2546 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:03:34.434526 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.434512    2546 scope.go:117] "RemoveContainer" containerID="b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561"
May 27 02:03:34.441394 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.441375    2546 scope.go:117] "RemoveContainer" containerID="8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b"
May 27 02:03:34.448391 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.448373    2546 scope.go:117] "RemoveContainer" containerID="095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d"
May 27 02:03:34.455178 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.455160    2546 scope.go:117] "RemoveContainer" containerID="1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb"
May 27 02:03:34.455448 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:34.455429    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb\": container with ID starting with 1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb not found: ID does not exist" containerID="1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb"
May 27 02:03:34.455514 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.455454    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb"} err="failed to get container status \"1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb\": rpc error: code = NotFound desc = could not find container \"1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb\": container with ID starting with 1f2196c7a7a0540f8e5ecc5d1b954d2bb46fed3cdf366089060952d43beb23bb not found: ID does not exist"
May 27 02:03:34.455514 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.455473    2546 scope.go:117] "RemoveContainer" containerID="6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63"
May 27 02:03:34.455691 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:34.455676    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63\": container with ID starting with 6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63 not found: ID does not exist" containerID="6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63"
May 27 02:03:34.455726 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.455694    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63"} err="failed to get container status \"6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63\": rpc error: code = NotFound desc = could not find container \"6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63\": container with ID starting with 6d8fa0d11d78fe982e4339730ab5429a381c3a155bce46d81d172a006e517d63 not found: ID does not exist"
May 27 02:03:34.455726 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.455709    2546 scope.go:117] "RemoveContainer" containerID="c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153"
May 27 02:03:34.455920 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:34.455899    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153\": container with ID starting with c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153 not found: ID does not exist" containerID="c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153"
May 27 02:03:34.456026 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.455921    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153"} err="failed to get container status \"c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153\": rpc error: code = NotFound desc = could not find container \"c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153\": container with ID starting with c9cbf28e407409f1267edc18bf6f70d28b038ca6bded68d43c3f2aec95a5b153 not found: ID does not exist"
May 27 02:03:34.456026 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.455934    2546 scope.go:117] "RemoveContainer" containerID="2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3"
May 27 02:03:34.456153 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:34.456132    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3\": container with ID starting with 2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3 not found: ID does not exist" containerID="2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3"
May 27 02:03:34.456189 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.456156    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3"} err="failed to get container status \"2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3\": rpc error: code = NotFound desc = could not find container \"2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3\": container with ID starting with 2099c75fba64b9103d21b57ca258c1c1662659eb20a3462abe6d4622b4350cd3 not found: ID does not exist"
May 27 02:03:34.456189 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.456170    2546 scope.go:117] "RemoveContainer" containerID="b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561"
May 27 02:03:34.456421 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:34.456401    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561\": container with ID starting with b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561 not found: ID does not exist" containerID="b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561"
May 27 02:03:34.456504 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.456425    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561"} err="failed to get container status \"b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561\": rpc error: code = NotFound desc = could not find container \"b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561\": container with ID starting with b04e29b9452d0ba6f55cacad19ae578fc07c7111e76df58c89c2d7ac90bbb561 not found: ID does not exist"
May 27 02:03:34.456504 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.456445    2546 scope.go:117] "RemoveContainer" containerID="8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b"
May 27 02:03:34.456758 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:34.456739    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b\": container with ID starting with 8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b not found: ID does not exist" containerID="8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b"
May 27 02:03:34.456882 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.456766    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b"} err="failed to get container status \"8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b\": rpc error: code = NotFound desc = could not find container \"8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b\": container with ID starting with 8ccb058d5b58330ff161bdbd75df8a2a32e5bd29bea51b044dd11cb99bf8c25b not found: ID does not exist"
May 27 02:03:34.456882 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.456786    2546 scope.go:117] "RemoveContainer" containerID="095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d"
May 27 02:03:34.457074 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:34.457055    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d\": container with ID starting with 095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d not found: ID does not exist" containerID="095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d"
May 27 02:03:34.457144 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.457078    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d"} err="failed to get container status \"095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d\": rpc error: code = NotFound desc = could not find container \"095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d\": container with ID starting with 095bc61e5ec109ac4d25e061b72baef5cb4b4aa9e4bbb4c9fad6fae1563f586d not found: ID does not exist"
May 27 02:03:34.458638 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458617    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:03:34.458942 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458927    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy-thanos"
May 27 02:03:34.458980 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458946    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy-thanos"
May 27 02:03:34.458980 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458958    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="prometheus"
May 27 02:03:34.458980 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458964    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="prometheus"
May 27 02:03:34.458980 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458971    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="thanos-sidecar"
May 27 02:03:34.458980 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458976    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="thanos-sidecar"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458985    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458990    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.458999    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy-web"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459004    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy-web"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459011    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="init-config-reloader"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459016    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="init-config-reloader"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459022    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="config-reloader"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459026    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="config-reloader"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459083    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="prometheus"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459093    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy-web"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459099    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="config-reloader"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459105    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459111    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="kube-rbac-proxy-thanos"
May 27 02:03:34.459140 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.459118    2546 memory_manager.go:356] "RemoveStaleState removing state" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" containerName="thanos-sidecar"
May 27 02:03:34.464620 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.464602    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.467334 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467281    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 27 02:03:34.467334 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467293    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 27 02:03:34.467334 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467305    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 27 02:03:34.467553 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467364    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 27 02:03:34.467553 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467308    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 27 02:03:34.467553 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467478    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 27 02:03:34.467688 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467656    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 27 02:03:34.467688 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467678    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 27 02:03:34.467788 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467749    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 27 02:03:34.467903 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467809    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 27 02:03:34.468008 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.467993    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 27 02:03:34.468064 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.468047    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-j5j95pg6qqo3\""
May 27 02:03:34.468229 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.468175    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fwhbn\""
May 27 02:03:34.471694 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.471670    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 27 02:03:34.474523 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.474502    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 27 02:03:34.475680 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.475640    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:03:34.612929 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.612894    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae113ae-4e62-44f4-82ea-1560c2c0121a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.612929 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.612937    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613066 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.612966    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613066 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613009    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613066 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613035    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613153 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613078    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613153 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613108    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613153 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613133    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613237 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613165    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613237 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613190    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613237 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613221    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613323 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613248    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-config\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613323 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613266    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613323 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613283    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x26f\" (UniqueName: \"kubernetes.io/projected/cae113ae-4e62-44f4-82ea-1560c2c0121a-kube-api-access-6x26f\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613323 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613310    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613473 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613391    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae113ae-4e62-44f4-82ea-1560c2c0121a-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613473 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613430    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.613473 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.613462    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714119 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714064    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae113ae-4e62-44f4-82ea-1560c2c0121a-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714119 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714100    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714263 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714151    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714392 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714370    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae113ae-4e62-44f4-82ea-1560c2c0121a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714469 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714417    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714534 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714470    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714534 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714499    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714534 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714525    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714677 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714559    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714677 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714621    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714677 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714657    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714688    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714713    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714755    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.714812 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714790    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-config\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.715000 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714817    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.715000 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714841    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x26f\" (UniqueName: \"kubernetes.io/projected/cae113ae-4e62-44f4-82ea-1560c2c0121a-kube-api-access-6x26f\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.715000 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.714886    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.716083 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.716056    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.718103 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.717566    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae113ae-4e62-44f4-82ea-1560c2c0121a-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.718103 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.717794    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae113ae-4e62-44f4-82ea-1560c2c0121a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.718268 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.718187    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.718268 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.718219    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.719914 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.719727    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.721368 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.720053    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.721368 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.720334    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.721368 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.720449    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.721368 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.720620    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.721368 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.721090    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.721766 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.721735    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.721885 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.721857    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-config\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.724417 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.722515    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.724417 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.722882    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.724417 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.724266    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae113ae-4e62-44f4-82ea-1560c2c0121a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.727893 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.727856    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x26f\" (UniqueName: \"kubernetes.io/projected/cae113ae-4e62-44f4-82ea-1560c2c0121a-kube-api-access-6x26f\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.728246 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.728219    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae113ae-4e62-44f4-82ea-1560c2c0121a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae113ae-4e62-44f4-82ea-1560c2c0121a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.776100 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.776078    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:34.911741 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:34.911706    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 02:03:34.915521 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:03:34.915493    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae113ae_4e62_44f4_82ea_1560c2c0121a.slice/crio-c65393d03e13d422e02a6939843d508759124108f004a7a28b1bdf868cedc6a6 WatchSource:0}: Error finding container c65393d03e13d422e02a6939843d508759124108f004a7a28b1bdf868cedc6a6: Status 404 returned error can't find the container with id c65393d03e13d422e02a6939843d508759124108f004a7a28b1bdf868cedc6a6
May 27 02:03:35.409194 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:35.409162    2546 generic.go:358] "Generic (PLEG): container finished" podID="cae113ae-4e62-44f4-82ea-1560c2c0121a" containerID="0f9f0fba030ae2bae5014239400b50ab200d50b8bfe1b08f50eaea759a6cab17" exitCode=0
May 27 02:03:35.409539 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:35.409200    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae113ae-4e62-44f4-82ea-1560c2c0121a","Type":"ContainerDied","Data":"0f9f0fba030ae2bae5014239400b50ab200d50b8bfe1b08f50eaea759a6cab17"}
May 27 02:03:35.409539 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:35.409220    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae113ae-4e62-44f4-82ea-1560c2c0121a","Type":"ContainerStarted","Data":"c65393d03e13d422e02a6939843d508759124108f004a7a28b1bdf868cedc6a6"}
May 27 02:03:35.549410 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:35.549379    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d69de8-0239-482e-82d5-a5a5e596d829" path="/var/lib/kubelet/pods/10d69de8-0239-482e-82d5-a5a5e596d829/volumes"
May 27 02:03:35.966638 ip-10-0-142-84 kubenswrapper[2546]: E0527 02:03:35.966562    2546 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d729j" podUID="d1f1468a-efa4-4fa7-a799-10bb8c650a84"
May 27 02:03:36.421877 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:36.421847    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae113ae-4e62-44f4-82ea-1560c2c0121a","Type":"ContainerStarted","Data":"94e37282058a19124dbf988d2c09d4173a0f01b6f1f127674ad227c9c2108edd"}
May 27 02:03:36.421877 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:36.421881    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae113ae-4e62-44f4-82ea-1560c2c0121a","Type":"ContainerStarted","Data":"914304788c8e2f1422678b9c864dd12c58a53c45c98a2323a004ccea06086dd2"}
May 27 02:03:36.422257 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:36.421892    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae113ae-4e62-44f4-82ea-1560c2c0121a","Type":"ContainerStarted","Data":"838ba06522ceca60304482016a06a6eda6af6ca5668e7d9c2619ab0cc1b10b50"}
May 27 02:03:36.422257 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:36.421900    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae113ae-4e62-44f4-82ea-1560c2c0121a","Type":"ContainerStarted","Data":"68e0dd87b2938061a853e89131d7efb5ef5334e3f8c0a8fff3a27b095fa9b12b"}
May 27 02:03:36.422257 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:36.421908    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae113ae-4e62-44f4-82ea-1560c2c0121a","Type":"ContainerStarted","Data":"7d5605f0930f0b89f5426b859ae1251276d4051b2da8fbcee5bcf3a43ef930a2"}
May 27 02:03:36.422257 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:36.421917    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae113ae-4e62-44f4-82ea-1560c2c0121a","Type":"ContainerStarted","Data":"d6f872dcabca365f519ad61e451d55cf1926db136dbdaee5c12d98e9093a82b9"}
May 27 02:03:36.422257 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:36.421896    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d729j"
May 27 02:03:36.462099 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:36.462059    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.462047894 podStartE2EDuration="2.462047894s" podCreationTimestamp="2026-05-27 02:03:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:03:36.459642249 +0000 UTC m=+281.543980531" watchObservedRunningTime="2026-05-27 02:03:36.462047894 +0000 UTC m=+281.546386175"
May 27 02:03:39.156004 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.155968    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 02:03:39.156664 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.156038    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 02:03:39.158925 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.158893    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1f1468a-efa4-4fa7-a799-10bb8c650a84-metrics-tls\") pod \"dns-default-d729j\" (UID: \"d1f1468a-efa4-4fa7-a799-10bb8c650a84\") " pod="openshift-dns/dns-default-d729j"
May 27 02:03:39.159060 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.158985    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e57004c2-92ef-468f-8f1e-a2312230a5e7-cert\") pod \"ingress-canary-gf8zq\" (UID: \"e57004c2-92ef-468f-8f1e-a2312230a5e7\") " pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 02:03:39.425133 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.425071    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ngvd\""
May 27 02:03:39.432763 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.432732    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d729j"
May 27 02:03:39.446879 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.446858    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tmrqj\""
May 27 02:03:39.455055 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.454977    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gf8zq"
May 27 02:03:39.578971 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.578944    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d729j"]
May 27 02:03:39.581865 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:03:39.581834    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f1468a_efa4_4fa7_a799_10bb8c650a84.slice/crio-54a0d624eae60b7950dd41165eb7df07b89acccfd91de70900380d822600f1c7 WatchSource:0}: Error finding container 54a0d624eae60b7950dd41165eb7df07b89acccfd91de70900380d822600f1c7: Status 404 returned error can't find the container with id 54a0d624eae60b7950dd41165eb7df07b89acccfd91de70900380d822600f1c7
May 27 02:03:39.594534 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.594512    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gf8zq"]
May 27 02:03:39.597421 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:03:39.597391    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57004c2_92ef_468f_8f1e_a2312230a5e7.slice/crio-daad8bedf559eb34cf8d06b99c954dd8881b0d8ab3976f247171eaa68656a728 WatchSource:0}: Error finding container daad8bedf559eb34cf8d06b99c954dd8881b0d8ab3976f247171eaa68656a728: Status 404 returned error can't find the container with id daad8bedf559eb34cf8d06b99c954dd8881b0d8ab3976f247171eaa68656a728
May 27 02:03:39.776546 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:39.776486    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:03:40.438146 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:40.438101    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gf8zq" event={"ID":"e57004c2-92ef-468f-8f1e-a2312230a5e7","Type":"ContainerStarted","Data":"daad8bedf559eb34cf8d06b99c954dd8881b0d8ab3976f247171eaa68656a728"}
May 27 02:03:40.439443 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:40.439403    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d729j" event={"ID":"d1f1468a-efa4-4fa7-a799-10bb8c650a84","Type":"ContainerStarted","Data":"54a0d624eae60b7950dd41165eb7df07b89acccfd91de70900380d822600f1c7"}
May 27 02:03:42.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:42.448480    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d729j" event={"ID":"d1f1468a-efa4-4fa7-a799-10bb8c650a84","Type":"ContainerStarted","Data":"4929506b6560079255b80afa994ace513f1423f0ca9df96a0b56bb0f49080592"}
May 27 02:03:42.448519 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:42.448526    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d729j" event={"ID":"d1f1468a-efa4-4fa7-a799-10bb8c650a84","Type":"ContainerStarted","Data":"0faece67375df61519b0ec45cb94bfcb35d3361f49465ac992d6ebe863329944"}
May 27 02:03:42.449087 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:42.448590    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d729j"
May 27 02:03:42.450201 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:42.450172    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gf8zq" event={"ID":"e57004c2-92ef-468f-8f1e-a2312230a5e7","Type":"ContainerStarted","Data":"435f0420cb41ee981457ba55a933c885c12c40bf2cde0ad16b73111e797e4e41"}
May 27 02:03:42.467018 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:42.466970    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-d729j" podStartSLOduration=251.670228528 podStartE2EDuration="4m13.466956307s" podCreationTimestamp="2026-05-27 01:59:29 +0000 UTC" firstStartedPulling="2026-05-27 02:03:39.583769698 +0000 UTC m=+284.668107961" lastFinishedPulling="2026-05-27 02:03:41.38049748 +0000 UTC m=+286.464835740" observedRunningTime="2026-05-27 02:03:42.464414315 +0000 UTC m=+287.548752596" watchObservedRunningTime="2026-05-27 02:03:42.466956307 +0000 UTC m=+287.551294665"
May 27 02:03:42.479579 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:42.479540    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gf8zq" podStartSLOduration=251.694830143 podStartE2EDuration="4m13.479526516s" podCreationTimestamp="2026-05-27 01:59:29 +0000 UTC" firstStartedPulling="2026-05-27 02:03:39.599169672 +0000 UTC m=+284.683507933" lastFinishedPulling="2026-05-27 02:03:41.383866033 +0000 UTC m=+286.468204306" observedRunningTime="2026-05-27 02:03:42.478787604 +0000 UTC m=+287.563125886" watchObservedRunningTime="2026-05-27 02:03:42.479526516 +0000 UTC m=+287.563864839"
May 27 02:03:52.455672 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:52.455634    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d729j"
May 27 02:03:55.468335 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:55.468307    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:03:55.468335 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:55.468319    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:03:55.473943 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:03:55.473924    2546 kubelet.go:1628] "Image garbage collection succeeded"
May 27 02:04:34.776785 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:04:34.776753    2546 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:04:34.791863 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:04:34.791839    2546 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:04:35.625102 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:04:35.625077    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 02:08:55.499665 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:08:55.499622    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:08:55.500929 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:08:55.500904    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:13:55.527676 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:13:55.527586    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:13:55.529868 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:13:55.529843    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:18:55.556270 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:18:55.556236    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:18:55.558051 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:18:55.558027    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:23:55.587499 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:23:55.587468    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:23:55.588801 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:23:55.588782    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:28:55.618028 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:28:55.617995    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:28:55.620761 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:28:55.620738    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:30:31.252617 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:31.252579    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pswlj_2c1a212b-da65-402f-a034-be00e61f3e56/global-pull-secret-syncer/0.log"
May 27 02:30:31.351447 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:31.351419    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rg4nb_4c86fb19-d79b-477c-9b82-ff2398809370/konnectivity-agent/0.log"
May 27 02:30:31.417998 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:31.417966    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-84.ec2.internal_f1da4437bdc14517242770227d1e0a59/haproxy/0.log"
May 27 02:30:34.591976 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:34.591947    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50cc595e-910c-4093-90c7-965b7f92c93c/alertmanager/0.log"
May 27 02:30:34.617150 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:34.617131    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50cc595e-910c-4093-90c7-965b7f92c93c/config-reloader/0.log"
May 27 02:30:34.641039 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:34.641021    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50cc595e-910c-4093-90c7-965b7f92c93c/kube-rbac-proxy-web/0.log"
May 27 02:30:34.664552 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:34.664537    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50cc595e-910c-4093-90c7-965b7f92c93c/kube-rbac-proxy/0.log"
May 27 02:30:34.684906 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:34.684888    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50cc595e-910c-4093-90c7-965b7f92c93c/kube-rbac-proxy-metric/0.log"
May 27 02:30:34.706182 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:34.706162    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50cc595e-910c-4093-90c7-965b7f92c93c/prom-label-proxy/0.log"
May 27 02:30:34.728026 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:34.728009    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50cc595e-910c-4093-90c7-965b7f92c93c/init-config-reloader/0.log"
May 27 02:30:34.776018 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:34.775971    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-h52js_4121ffb1-5942-4528-99cc-1a3cb9dcabd1/cluster-monitoring-operator/0.log"
May 27 02:30:35.009754 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.009725    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9pkl8_e8f1ff60-1fbd-4ae2-86be-679d0bb146cc/node-exporter/0.log"
May 27 02:30:35.028620 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.028592    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9pkl8_e8f1ff60-1fbd-4ae2-86be-679d0bb146cc/kube-rbac-proxy/0.log"
May 27 02:30:35.051136 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.051114    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9pkl8_e8f1ff60-1fbd-4ae2-86be-679d0bb146cc/init-textfile/0.log"
May 27 02:30:35.234886 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.234812    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae113ae-4e62-44f4-82ea-1560c2c0121a/prometheus/0.log"
May 27 02:30:35.256622 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.256589    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae113ae-4e62-44f4-82ea-1560c2c0121a/config-reloader/0.log"
May 27 02:30:35.284502 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.284482    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae113ae-4e62-44f4-82ea-1560c2c0121a/thanos-sidecar/0.log"
May 27 02:30:35.314754 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.314736    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae113ae-4e62-44f4-82ea-1560c2c0121a/kube-rbac-proxy-web/0.log"
May 27 02:30:35.345102 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.345080    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae113ae-4e62-44f4-82ea-1560c2c0121a/kube-rbac-proxy/0.log"
May 27 02:30:35.371144 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.371121    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae113ae-4e62-44f4-82ea-1560c2c0121a/kube-rbac-proxy-thanos/0.log"
May 27 02:30:35.405915 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.405897    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae113ae-4e62-44f4-82ea-1560c2c0121a/init-config-reloader/0.log"
May 27 02:30:35.485223 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.485143    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-vtpnw_49d7d747-4f22-4224-a5f4-e7995330a6ab/prometheus-operator/0.log"
May 27 02:30:35.521958 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.521935    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-vtpnw_49d7d747-4f22-4224-a5f4-e7995330a6ab/kube-rbac-proxy/0.log"
May 27 02:30:35.558250 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.558154    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-vbtwb_42cbce46-97d2-4dcf-bfc7-2b851246bf75/prometheus-operator-admission-webhook/0.log"
May 27 02:30:35.702242 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.702212    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6784c76598-m28z5_9e09bd4f-5764-4cdb-9892-b5a3c4c404b6/thanos-query/0.log"
May 27 02:30:35.726356 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.726317    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6784c76598-m28z5_9e09bd4f-5764-4cdb-9892-b5a3c4c404b6/kube-rbac-proxy-web/0.log"
May 27 02:30:35.754702 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.754638    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6784c76598-m28z5_9e09bd4f-5764-4cdb-9892-b5a3c4c404b6/kube-rbac-proxy/0.log"
May 27 02:30:35.777876 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.777855    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6784c76598-m28z5_9e09bd4f-5764-4cdb-9892-b5a3c4c404b6/prom-label-proxy/0.log"
May 27 02:30:35.815425 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.815400    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6784c76598-m28z5_9e09bd4f-5764-4cdb-9892-b5a3c4c404b6/kube-rbac-proxy-rules/0.log"
May 27 02:30:35.841634 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:35.841613    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6784c76598-m28z5_9e09bd4f-5764-4cdb-9892-b5a3c4c404b6/kube-rbac-proxy-metrics/0.log"
May 27 02:30:37.642521 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.642488    2546 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"]
May 27 02:30:37.645595 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.645574    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.647952 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.647935    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n92xx\"/\"kube-root-ca.crt\""
May 27 02:30:37.648890 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.648871    2546 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n92xx\"/\"default-dockercfg-f78xs\""
May 27 02:30:37.648971 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.648871    2546 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n92xx\"/\"openshift-service-ca.crt\""
May 27 02:30:37.654059 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.654037    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"]
May 27 02:30:37.794605 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.794574    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-sys\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.794605 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.794601    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-proc\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.794784 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.794622    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2222p\" (UniqueName: \"kubernetes.io/projected/05c9c144-a574-449e-a0f0-9164a8fb8ab7-kube-api-access-2222p\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.794784 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.794694    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-lib-modules\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.794784 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.794727    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-podres\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895622 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895540    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-sys\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895622 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895581    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-proc\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895622 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895607    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2222p\" (UniqueName: \"kubernetes.io/projected/05c9c144-a574-449e-a0f0-9164a8fb8ab7-kube-api-access-2222p\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895803 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895659    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-sys\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895803 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895664    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-proc\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895803 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895669    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-lib-modules\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895803 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895735    2546 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-podres\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895803 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895785    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-lib-modules\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.895954 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.895826    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05c9c144-a574-449e-a0f0-9164a8fb8ab7-podres\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.902941 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.902915    2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2222p\" (UniqueName: \"kubernetes.io/projected/05c9c144-a574-449e-a0f0-9164a8fb8ab7-kube-api-access-2222p\") pod \"perf-node-gather-daemonset-l2gp7\" (UID: \"05c9c144-a574-449e-a0f0-9164a8fb8ab7\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:37.955604 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:37.955577    2546 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:38.080846 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.080817    2546 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"]
May 27 02:30:38.083403 ip-10-0-142-84 kubenswrapper[2546]: W0527 02:30:38.083373    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05c9c144_a574_449e_a0f0_9164a8fb8ab7.slice/crio-8c241422f8f7c3e1ae1b74808e0bd609af47abdfee4fd555dc9a3ec65b90a5f9 WatchSource:0}: Error finding container 8c241422f8f7c3e1ae1b74808e0bd609af47abdfee4fd555dc9a3ec65b90a5f9: Status 404 returned error can't find the container with id 8c241422f8f7c3e1ae1b74808e0bd609af47abdfee4fd555dc9a3ec65b90a5f9
May 27 02:30:38.085108 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.085093    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 02:30:38.478680 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.478647    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7" event={"ID":"05c9c144-a574-449e-a0f0-9164a8fb8ab7","Type":"ContainerStarted","Data":"f36cedc5fc60eaccec624022856a2960eb1ab81d54243dfd7245d7b8bb483de8"}
May 27 02:30:38.478680 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.478686    2546 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7" event={"ID":"05c9c144-a574-449e-a0f0-9164a8fb8ab7","Type":"ContainerStarted","Data":"8c241422f8f7c3e1ae1b74808e0bd609af47abdfee4fd555dc9a3ec65b90a5f9"}
May 27 02:30:38.478945 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.478769    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:38.494435 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.494391    2546 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7" podStartSLOduration=1.494379038 podStartE2EDuration="1.494379038s" podCreationTimestamp="2026-05-27 02:30:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:30:38.49263215 +0000 UTC m=+1903.576970433" watchObservedRunningTime="2026-05-27 02:30:38.494379038 +0000 UTC m=+1903.578717317"
May 27 02:30:38.510939 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.510919    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d729j_d1f1468a-efa4-4fa7-a799-10bb8c650a84/dns/0.log"
May 27 02:30:38.530700 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.530680    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d729j_d1f1468a-efa4-4fa7-a799-10bb8c650a84/kube-rbac-proxy/0.log"
May 27 02:30:38.674582 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:38.674552    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxkhd_ebdb4199-7ea7-42c4-8c69-ba63d7049d8e/dns-node-resolver/0.log"
May 27 02:30:39.045091 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:39.045057    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-795d4b9689-7gb52_3d6bdb31-c6e5-40c9-9275-b85e540df3ca/registry/0.log"
May 27 02:30:39.086016 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:39.085993    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bbwkl_6eedf9d0-32bb-47c6-8205-8e53b3a43ded/node-ca/0.log"
May 27 02:30:39.759874 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:39.759608    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55cf9d8586-5npg6_f0bbaa3b-6f34-4a09-8399-ffe11d73ebf3/router/0.log"
May 27 02:30:40.072159 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:40.072129    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gf8zq_e57004c2-92ef-468f-8f1e-a2312230a5e7/serve-healthcheck-canary/0.log"
May 27 02:30:40.480717 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:40.480625    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktj4s_3faae558-918e-40c6-86e4-fd6d6eff006e/kube-rbac-proxy/0.log"
May 27 02:30:40.499334 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:40.499312    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktj4s_3faae558-918e-40c6-86e4-fd6d6eff006e/exporter/0.log"
May 27 02:30:40.518639 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:40.518607    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktj4s_3faae558-918e-40c6-86e4-fd6d6eff006e/extractor/0.log"
May 27 02:30:44.492564 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:44.492537    2546 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-l2gp7"
May 27 02:30:44.603851 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:44.603812    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-v8spg_f5050292-e23b-4e71-86ba-9f651f950347/kube-storage-version-migrator-operator/1.log"
May 27 02:30:44.605621 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:44.605589    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-v8spg_f5050292-e23b-4e71-86ba-9f651f950347/kube-storage-version-migrator-operator/0.log"
May 27 02:30:45.656414 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.656388    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n84kv_654c5a26-d73f-42b0-b44f-8e76e6b56685/kube-multus-additional-cni-plugins/0.log"
May 27 02:30:45.675396 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.675370    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n84kv_654c5a26-d73f-42b0-b44f-8e76e6b56685/egress-router-binary-copy/0.log"
May 27 02:30:45.694470 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.694452    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n84kv_654c5a26-d73f-42b0-b44f-8e76e6b56685/cni-plugins/0.log"
May 27 02:30:45.712541 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.712521    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n84kv_654c5a26-d73f-42b0-b44f-8e76e6b56685/bond-cni-plugin/0.log"
May 27 02:30:45.732014 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.731991    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n84kv_654c5a26-d73f-42b0-b44f-8e76e6b56685/routeoverride-cni/0.log"
May 27 02:30:45.751036 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.751016    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n84kv_654c5a26-d73f-42b0-b44f-8e76e6b56685/whereabouts-cni-bincopy/0.log"
May 27 02:30:45.773122 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.773106    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n84kv_654c5a26-d73f-42b0-b44f-8e76e6b56685/whereabouts-cni/0.log"
May 27 02:30:45.802831 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.802810    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dcwrh_7acdc3b2-f3ec-4b0a-ab16-e6e8b2ca1230/kube-multus/0.log"
May 27 02:30:45.946508 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.946419    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zdfpv_6ae416e9-a5f3-4e13-b60f-f60797baf9ae/network-metrics-daemon/0.log"
May 27 02:30:45.963828 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:45.963803    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zdfpv_6ae416e9-a5f3-4e13-b60f-f60797baf9ae/kube-rbac-proxy/0.log"
May 27 02:30:46.780437 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:46.780318    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-controller/0.log"
May 27 02:30:46.796129 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:46.796107    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/0.log"
May 27 02:30:46.813470 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:46.813441    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovn-acl-logging/1.log"
May 27 02:30:46.836032 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:46.836009    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/kube-rbac-proxy-node/0.log"
May 27 02:30:46.856993 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:46.856971    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/kube-rbac-proxy-ovn-metrics/0.log"
May 27 02:30:46.871996 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:46.871974    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/northd/0.log"
May 27 02:30:46.891314 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:46.891296    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/nbdb/0.log"
May 27 02:30:46.912187 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:46.912162    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/sbdb/0.log"
May 27 02:30:47.070637 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:47.070607    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rk7n_a1f8dcf0-efe7-44dc-b941-b0d3aa60524d/ovnkube-controller/0.log"
May 27 02:30:48.566535 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:48.566510    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kk9c7_ee6567a5-1576-4ea7-b9eb-d771924c8967/network-check-target-container/0.log"
May 27 02:30:49.354937 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:49.354899    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5jn6n_8ef2ab27-0259-4a0f-917f-207cc376b402/iptables-alerter/0.log"
May 27 02:30:49.969032 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:49.969003    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lqpp2_eb719311-7963-4409-b1bf-5ee45d1bf7df/tuned/0.log"
May 27 02:30:52.458811 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:52.458772    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-wpmsc_631d8adb-7415-42da-9494-5a1d17471847/service-ca-operator/1.log"
May 27 02:30:52.460445 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:52.460406    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-wpmsc_631d8adb-7415-42da-9494-5a1d17471847/service-ca-operator/0.log"
May 27 02:30:52.763969 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:52.763887    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-t5zw4_45e7724a-5718-4a91-ae35-53926da3b2f5/service-ca-controller/0.log"
May 27 02:30:53.074101 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:53.074069    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hqmtx_3ae4e048-7590-4b5d-9c3b-8f0beaaf72df/csi-driver/0.log"
May 27 02:30:53.092782 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:53.092751    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hqmtx_3ae4e048-7590-4b5d-9c3b-8f0beaaf72df/csi-node-driver-registrar/0.log"
May 27 02:30:53.110655 ip-10-0-142-84 kubenswrapper[2546]: I0527 02:30:53.110636    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hqmtx_3ae4e048-7590-4b5d-9c3b-8f0beaaf72df/csi-liveness-probe/0.log"